Using gems to get a stamina refill is almost always silly, honestly.
It "just" speed up things a little bit, giving you more gold/manyuus/seeds/gifts... which can be farm every day, while using gems is the only way to get 5* (and 6*, but eh).
Obviously, you'll sometimes get bad draws, but you can't really say that rates are bad...
Except if it's for a time-limited quest, there is no need to rush (and to use gems to get a refill), as you can always try again later.
Why are you stopping at 23 medals ?
I mean, why are you saying "no" to 2 free gems + a power-up on Lavander ?
Unless you're not powerful enough, of course, yeah.