For me, it's usually Joan of Arc or Mordred that this occurs, probably because they're the only one I use. For Joan, its usually her damage reductjon skill she doesn't use immediately when its up.