Yes I would really recommend it. You could catch the train from Montreal to Quebec City, it is not that far, well by Australian and Canadian reckoning of distances. Stay a few days. I know I stayed in a reasonably central hotel. Small but nice and not that expensive, but it was a while ago. It was in the old part of the town and I think it was called La Maison Demers.