Apparently I can't add links in my post, so I'm rewriting it.
The latest patch calculates the ego differently. From the Kinkoid blog post...
You have to reorganize your equipment and what girls you have in your battle team. I had to swap my 'rainbow' equipment for specialized (charm) gear to get my ego back up where is was....points from the hero and the equipment were giving different values. Now each point in the primary, secondary and tertiary stat will give the same amount of bonuses from your Hero and also Equipment.
Just another way Kinkoid is penalizing players.