The only way to know when you're strong enough for Accessory Quests is to try.

Never spend Elixirs in content that you can access however you want.