Open your harem tab, then select a girl and on the girl's profile you'll see affection stars, try clicking on them :P