Ryan made a great video about this:
As has become the norm, I have a lot of issues with his pat (and sometimes infuriatingly smug) conclusions, but some of the points are valid.
To me, the press cycle on a motorcycle is as follows:
- 'Pre-release hype', up to and including price info, photos (my favourite are the faux spy shots), rumoured specs, etc. New R7 is here now.
- 'First Ride', the launch with all the stuff Ryan is talking about, including all expenses paid trips to exotic locales and very controlled routes on group rides playing follow-the-leader. This is almost never critical, mostly because the point is to get out the basic details to interested potential buyers and the rest of us voyeurs.
- 'Road Test', where a bike is given to a publication for a period of time unsupervised for them to ride in their home turf. This is where I think the actual criticism should start, with hard questions asked and bikes put through their paces. At least a clear picture should be formed about what the bike does and doesn't do well.
- 'Comparison/Shoot-Out/Group Test', where bikes in a segment are pitted against each other with a clear remit for what the ideal one is for. Tourer, ADV, sportbike, etc. To me, this is where the gloves come off, with winners and losers declared, faults highlighted, and preferably a ranking. This is also the point where the real publications separate themselves from the the softball lobbers, as giving a verdict of, "They're all great, just pick the one you like!" being essentially useless. The old Cycle World and Motorcyclist paper magazines used to be awful for that...
- 'Long Termer', where the goal is to talk about the ownership experience, particularly in relation to modifying the bike to fix flaws. This is rare with online publications, but the paper ones still do them. For example, BMW, Honda and Kawasaki have gimped their superbikes in North America to pass EPA regs. If you flash the ECU, how much better do they get?
The real beef I have with the F9 video is where he criticises publications or journalists for saying modern bikes are all pretty good. That's fine, but he doesn't offer any evidence to the contrary. Modern bikes
are mostly all pretty good, it's only by comparison with the competition that they can be diminished. Take the MT-10, for example. In a vacuum, it's an extraordinary bike. Massive power, amazing handling, you name it. It's only by pitting it against the newer competition that you can say it has a less fun motor, or offers less value, has less character or whatever. And even then, for some folks it would be perfect. If you dig the looks, or like the sound, or the ergos fit you better, or you get a deal, on and on, the list is long.
I'd be curious if anyone can name a modern bike made by a major manufacturer that's objectively bad. Some have flaws, for sure, but that doesn't make them bad bikes. Similarly, none are to everyone's taste, but none are to nobody's taste, either. Reliability doesn't count, as it's near impossible for journalists to evaluate that in a meaningful way...