I leave from Browns Line, usually around 8. Every couple of minutes earlier makes a huge difference. One thing I've found over almost 25 years of going downtown, is that unless there is an actual blockage on the Gardiner somewhere, it will still be faster from the Browns line to Park Lawn stretch to stay on the Gardiner instead of Lakeshore - it's just too far out of the way, and there are too many lights to get there, and too many lights along there. Queensway similar, but not as bad. Getting off at Browns Line/Evans and taking Evans isn't as bad, but you're really only saving the time to Islington, because you can't easily get back on after that. Means another several intersections and turns to Lakeshore or Queensway.
One of the tremendous benefits of the Evans to Royal York, through the residential neighbourhood and down to Lakeshore route is that It's More interesting and you're moving and stopping for red lights - not creeping and stopping in a straight line.
The other thing to remember, which is something I still kick myself for occasionally, is to not get fooled into thinking it will be faster because it looks faster - if the Gardiner is blocked, everything else will be busy. It's better than sitting on the highway, but if you're in a hurry you're better to stay on the Gardiner. When it's cleared, it will pick up (the big problem here is that if it's going to be a long clean up or investigation, you don't know that.
Of course, none of this matters if you end up riding on the shoulder....