I have mixed feelings about this. Summers are nice in the north, you have bugs to put up with but you get longer days May thru October, the recreational opportunities are boundless, cultural and sports are TV only. Property prices are a fraction of what you pay in Toronto - Sudbury, North Bay, and Timmins have a reasonable cost of living and have excellent highway and air connections to Toronto or Montreal.
A $2m home in Markham can be had for $500K in one of those cities. The extra $1.5M would be enough for a comfortable retirement including wintering in Florida, Arizona, Mexico or many spots in Central or South America.
I really like visting Sault Ste Marie