I also asked what would happen in the scenario that I posted above with TD. This adviser claimed that I would not have to return to Canada to unblock a TD debit card
I can verify that.
I've had my TD Debit card blocked many, many times in the last couple of years. And yes, they do know I'm traveling, but the note seems to get removed every few weeks. Quick phone call and it's unblocked immediately.
I probably have the most suspicious-looking ATM activity ever.