Visiting Green Bay for Packers game

My wife and I are planning to go to the 49ers/Packers game in November. It looks like we can't fly direct to Green Bay so will probably fly into Milwaukee and drive up. My question is: for a weekend to should we stay in Milwaukee and just drive up to see the game, or should we stay over in Green Bay? We've never been to either city -- which has better hotel options and good restaurants? Thanks for any advice!