A lot of the older silent switches while silent, have a lot of drawbacks. Recently there have been a lot of silent switches that have been using the stem acting as the dampener with a relief cut in the stem to quieten the bottom out instead of a piece of rubber dampening it, which removes almost of all of the drawbacks of a traditional silent switch. They also have holes in the bottom housing of the switch, which also makes it quieter (I believe by dispersing the sound waves so that they don't bounce of the switch as much creating less resonance but I'm not 100%)
One manufacturer makes them but sells them under different companies Wuque and Haimu, both seem to be really similar though, so just find the one that fit's your preferences more. The prices are very similar to the prices I've seen for mx silents so they are pretty decent value. They are pre-lubed so if you want to manually lube them then you will have to clean them.