I honestly just recommend playing normally. It starts to pile up when you have nothing else to break limit as there isn't much use for gems aside from (at least for now it seems) rolling regular gatcha for enhancing and donating to union.
Do the material exchange in the shop.