Cruise control for cool :panda:
What's your OS and how did you get Colemak on it?
A one-off fix might be switching to qwerty, toggling caps lock and going back. Or rebooting.
Then if you don't want it do happen again, find out how it is toggled. Maybe it's a feature, for example, I toggle caps lock by pressing both shifts at the same time. But I had to enable that myself (Linux).