Pretty sure you have to level up the temple to unlock harbor. It's been so long since I did it I do not remember for sure though. I know for sure you have to level the temple to 30 and 40 to unlock equipping the 2nd and 3rd artifact slots in harbor, so I think unlocking the harbor was level 20 temple.