To add another arbitrary data point, yesterday I was rank 180 but had to sit out one battle because I mistimed when one of my defense kamihime came off cooldown. This morning I was rank 351 with about 5700 medals. A 171 rank drop doesn't seem like it's a whole lot for sitting out an entire battle, so maybe by this point there really are only a few hundred able to clear floors.