Hmm so doesn't seem like theres an easy way, out of those solvents, to remove the lettering without damaging the plastic key itself.
I've heard somewhere that brake fluid as a solvent works for removing keycap lettering. Does anyone have any experience with that or am I going to have to bite the bullet and find out for myself?