Also, since affection adds a multiplier to damage, you don't want to go in with anyone but your highest-affection girls in the first place. If you go in with lower-affection girls, you'll just lose a bunch, so you can't even level them up that way.