If mini-bosses are getting hard to beat, it's almost always time to rebirth, unless you're very close to a higher reward tier or have almost enough gold for the next hero in line.

I've never run into anything that causes hero DPS to go down other than Bloodlust running out or heroes getting killed.