There is supposedly a cap to Accessory stats, but for Affliction, you cannot realistically reach it. For example, I think that for Def up, the cap is a whopping 40%. With our current available slots, the most you can get is 27%.
So, absolutely stack at least 3x Affliction to any Hime who has debuffs.