Affection and cash costs increasing for larger harem sizes was done away with when they implemented rarities for the girls. A legendary like Taria will cost the same whether she was your 8th girl or 800th.
I have no idea about the drop chances. I doubt it goes down for harem size.