Old thread, but I've noticed that killing his orbs progresses the fight. Killing the Vahnavoi exclusively will not work.
Edit: this may be a coincidence, but I've also noticed that defeating both orbs in the same round has always resulted in the next dialogue appearing.