I was having that problem as well at first but I found that if you go and talk to Houghton after completing the first leg of the Inverted bandit mission the city can be opened. Ask him what else you can do for avernum and he'll send you to Almaria to talk to the mayor. After that I had no problem getting into the city.