I did a few tests a while ago with Brown (103WPM), Black (106WPM), and Matias Quiet (104WPM) switches. A marginal difference, but I was indeed fastest on Black switches. I still don't like the feel. I'll take a slight decrease in speed over tactility.
I should drag out the Model M and see what I get on that...