It was this issue:
https://github.com/qmk/qmk_firmware/issues/922And sorry I missed those flags in Makefile, I looked at the Makefile for the flags, but somehow missed them, thought they were deprecated
#MOUSEKEY_ENABLE ?= yes # Mouse keys
EXTRAKEY_ENABLE ?= yes # Media control and System control
#CONSOLE_ENABLE ?= yes # Console for debug
#COMMAND_ENABLE ?= yes # Commands for debug and configuration
#NKRO_ENABLE ?= yes # USB Nkey Rollover
It reduced the .hex from 81kb to 63kb - haven't tried flashing it yet, but very promising so far
Mouse keys are pretty cool, but apart from being cool, never used anyway
By the way, as a bit of side info for anyone, I tried using
https://github.com/luizribeiro/tmk_keyboard/tree/ps2avrGB/keyboard/ps2avrGB directly on my FaceW PCB, however, "wait_ms() / _delay_ms" doesn't work with VUSB well, they are erratic and awkward - I have a lot of custom code on my TMK (thanks to you hasu:
https://github.com/tmk/tmk_keyboard/issues/233)
And long story short, I just couldn't reproduce what I have with the usb-usb converter using the direct port, tho it was pretty cool using TMK directly on the PCB, without assistance, it works awesomely if you don't use delays (the answer isn't crucial, but I do wonder why delays work on one setup and not in the another, I'm guessing, since these MCU's have built-in USB routines, maybe they handle delays on that level, and not sever the USB communication during delays?)