Yes, I've lost battles because I took too long and my debuffs fell off at a critical moment. Spamming eidolon skills is a great way to use up your debuff timers due to the enforced waiting period after each use.
Are you talking about the "Finishing previous turn" thing? Seems they fixed that recently.