Accessory upgrading uses an extreme amount of gems and I believe awakenings require a hefty amount as well.