Though I wonder if muscle memory of being full on the gas and braking at the limit would hurt in street riding .
I don't wonder it at all - I am a much better street rider since I started doing track, I actually used to think I was awesome at street riding (don't we all) until I realized how mediocre I was (even when i was better than most).
I keep telling this story:
went to PA with a group of about 10 people - 4 of us went riding at a good pace and everyone stayed behind, 3 of us were racers, 1 was a street rider, we took a decreasing radius turn (called the dead man corner) and none of us knew it was a decreasing corner.
Out of the 4 riders, 1 crashed badly when he freak out and went straight off road into the barrier and 3 made it by scraping pegs to the max on street bikes. Guess who made it and who didn't!
Muscle memory helps you with decisions where your brain does not have time to react in time or your instinct takes in.