Well, it's a low-torque application, so even a nut driver that is slightly loose on the screw will still work OK.
But, at least with the Craftsman sockets, I've found that 5.5mm is just right. Even though there's a low chance of stripping the screw head, why take the chance?