Thanks for the reply!
Yes, I think you are right that this is the way to do it. I'm not sure if i will have to flip diodes, but I am a bit worried that the firmware will be all flipped around. Also not sure if the switches will work right on the "wrong" side of the pcb, but if I understand switches, they should. This solution is also better since I would actually prefer to have my usb on the left side anyways!
I'll report back here after I've had the chance to pick up parts for a second dox to test with.