Don't sand actually, I take that back. Try to use a small, flat file that can make sure you still get a very flat profile. You don't want the keycap to be sitting on the plunger without solid contact (this will cause excessive wiggle and eventually premature failure of either plunger or keycap). I would just let it be, and don't force it down too hard.