I have the same problem, gathering decrease my stamina