Cork is a bit grainy and dampers inside switches tend to be very small. I'd be afraid that it could too easily fall apart and/or be inconsistent at such a small size.
Cork has otherwise successfully been used for cases, wrist rests, between plate and PCB, under PCB, as feet and as for "keyboard pads" to place the keyboard on top of.