Your brain likes predictability. I remember when I was a kid my “friend” said “bet you can’t ride a bike with your hands crossed over the bars“. He was right. That fall hurt.
Theres a rare side effect of some viral diseases (not COVID) where your eyes become unyoked. One eye can move independent of the other. Apparently it’s about as nauseating as you think it might be and a constant vomit session when your eyes are open.
The brain is malleable and rewireable though. I watched a documentary about an experiment where a guy wore glasses that turned his vision up-side down. He couldn't walk or navigate initially. But after a week of wearing those glasses, the brain rewired itself to "right-side" the upside-down image and he could function just as normally as he could before he put the glasses on.
Then he took the glasses off but his brain kept turning what his eyes saw upside-down all over again. Had to wait another week for the reset.
Fascinating stuff.