Welcome to Geekhack!
Do you bottom out on the switches you have? Most MX switches sound similar if you bottom out with enough force, just that blues have a extra high-pitched click as they actuate (which happens half way down, not when you bottom out).
You could also consider O-rings to reduce the noise from bottoming out.