I'm not an engineer, but I do have some basic education in physics… and a certain amount of skepticism.
First, how heavy are the keys? See manufacturing tolerances for switches. There's a quite large range. The simplest, most straightforward answer.
But still, they may feel lighter or heavier under various circumstances. You feel that with your hands, and so it depends how your hands are sensitive or how much force you use at the moment, which varies depending on temperature, what you were doing previously etc.
Furthermore, your overall perception is affected by other senses too. That's where psychoacoustics and various other biases come into play. Try a "deaf" test of different switches, or the other way around: use a buzzer even with quiet switches.
Keycaps can't really change the force requirements of keys: it's negligible, whether a keycap weighs 1g, or 2g, when the whole switch takes 60cN ± tolerance. However, they can change acoustics a lot. More or less space to amplify switch sound, thicker walls to block some frequencies etc. The brain then takes it into account.
The overall keyboard construction has the same effect, and if it's flimsy, it may flex, creak, you name it. You could take another step to room acoustics… but really, are we talking about a musical instrument, or a typing device? I think the latter.