I would see about cutting some thick flexible material, and putting it under the keycap. It'd provide something to pull against, and may help the stem stay in place.
I thought about fabricating something when I pulled off my anodyzed aluminium keycaps, but I was able to manage.