I've felt the "grit" associated with the feeling of typing on browns only in a switch sampler. When actually typing with brown switches, however, I hardly notice the tactile bump, but it's enough so that I hardly bottom out when I type.
In regards to gaming, browns have as good a reputation in that area as reds do.
I don't know what threads you read that gave you the overall impression that browns aren't preferred; you'll find that every switch-type has mixed reviews--especially the most popular ones. Other peoples' opinions are great to have, but if you like the feeling of browns over reds, don't pick reds just because you noticed most people prefer them.
I went to my local Best Buy and found the reds lacking compared to the browns. If you really like the blues, I think the browns would be a good step for you. And if you find yourself bottoming-out using browns or blues, consider getting clears when the cost becomes justifiable. Unless you're all about bottoming-out.
There's a drop for the
Leopold FC660M that you might want to consider. There's a clear switch option for the same price as the other switches, and even with shipping, it should cost about as much--if not less--than the ones you're considering now. I've only had the browns for a short time and I already know they're a tad too light for my current taste. It's not exactly a TKL, and it has no backlighting, but it's got your dedicated arrow keys.