Did you already check the Japan Shopping Wiki on /r/mechanicalkeyboards? If not do so first.
Afaik the most interesting shop was closed a few years ago, but it's always worth checking big malls and electronics stores. I'm sure you'll find a lot in Akihabara. It's just insane how many keyboards are on display in these electronics stores there.
No idea about keycaps though.