I'd be quite surprised if you broke the stem or slider while removing the caps. I've got some RF caps that grip like hell (can literally lift the hhkb by pulling it with the wire keypuller and not holding it down), and have had no problem with stem or sliders.