Ok. I plugged the cable directly into Teensy and tried. It was the same B5 and B6 did not have any voltage. Also, the other wise (the row where ground pin exists) also didn't have voltage. Does this mean the Teensy is faulty or my voltmeter is not reliable? Or could it be the PCB?
One thing I noticed was, B5 and B6 didn't have any voltage on my Ergodox that does work (one I built before this one). It, however, has voltage on the row that has the ground pin.