Best advice is to ignore this blooming thing and just continue maxing your Flower Knights' normal affection. You'll probably find Flower Gems much more useful than the extra stats on just one girl. Plus, I don't want to see my girls stats bugging out since there's still some bugs that aren't fixed.