If you have a Teensy look at the resistors attached to the middle two pins behind the socket - those are what I would solder to as they're significantly bigger spaced than the connector's pins. If you feel confident great, 5v and ground are the corner pins of the Teensy so no problem there.
If you just want to move the port I'd be tempted to buy a cable mount mini USB plug to plug in to the Teensy, you can wrap it in tape or heatshrink and discard any plastic casing which would make it thicker. This would also keep the USB cable twisted and shielded for it's full length, probably won't make a difference but would look tidier if that matters.
Either way the old socket would still be there so you keep super compatiblity - if you can get your fingers in there to plug in a different cable...