64-bit actually requires more data to be processed than 32-bit, requiring more memory (which can make swapping more likely,) more memory bandwidth, and more processor resources. (Granted, those resources may be wasted by a 32-bit program, but I digress.)
For something which works exclusively with 32-bit data, like a web browser, 32-bit is at the very worst the same speed.