Make your 5 stars and 4 stars priority on leveling. You will want to evolve those characters first as well.

Do the same for your affection as well.