I've found only a few flower gems (about 11-15) in my box.
Looking at the description, it's probably because I've completed most of the national battle missions.
Now that those have been remade, they're probably giving out the remainder of gems we could have gotten before.