Oliver not opening portal fix

If you are trying to get oliver to open a portal and he just wont and you talked to Halsin and the quest still says talk to him, it will fix later on after you kill a certain someone and have a big party. You have time before act 3 to fix it.