That's probably because you're currently in the first wold map location "Rotten Relic", change location and arrow should disappear.