To make it work people need to have the balls to tell the morons to cool it. Nicely of course.
I've done just that, a few times. Where I go, it hasn't been necessary all that often, but it has happened.
Generally, the people who are making too much noise, know they're doing it, and it seems to be different when another rider tells them to quiet down.