I've completed the three rooms in the Training Grounds, got the "no-stone bracelet", and found the golem way too hard at that point, so I did everything else and left the island. Now I'm half way through the Isle of Spears and tried to go back, but found the entire complex empty. Is it too late for me to pass the tests now?