flower knights make up the entirety of the world's military force, their magical nature probably lets them kill pests far better then a normal human with a sword. so while normal civilian men exist, the knight commander basically lives at the flower knight barracks and 'mingles' with them a lot more then anyone else.

also, considering flowers are literally planet reproductive organs it isn't odd some would be more inclined to indulge. course another thing about how real flowers work would mean all of them should technically be futanaris since flowers have both pistels and stamen.