I've currently got a 27" for my main screen and lately I feel like it is slightly too small.
I'm not sure if 32" would even be that much of a size difference, but at the same time I am worried about desk footprint and anything in the 40" range seens like it might be too big at an arms length away from your face.
What is your optimal size and distance/setup?