So, I did the quest to kill Elhioc, and then I left the castle to bum around and do various things. When I returned to finally kill Vothkaro, I find that I am unable to enter the castle. I'm stumped. Is there a way to get back in? Perhaps an item I ditched?