You can get rid of them whenever. If events keep up, you'll be rolling in Golds soon enough.