If, as implied, you desoldered the switch, you could take it apart, soak the parts in alcohol or soapy water, and maybe scrub them a bit with a sponge or your fingers, maybe that'll get the residue off. However, after this, the lube will also wash off, and you'll need to put some silicon or lithium grease in the switch to make it smooth again. I'm no expert on greasing, maybe somebody else can give a better suggestion.