I finally built my board and it turned out that it was pretty much unusable with the bootmapper firmware (random disconnects and sometimes just stopped generating any output).
Flashing the board to QMK actually fixed these problems and it works all fine now, however the backlight now doesn't work.
Does anybody know how to get the backlight to work with QMK on this board?