I'm about your size, though I've lost 30 pounds this past year, so down to 6'2", 235. I'm also legally blind, so that adds another wrinkle. People want to come up to me because I'm big, but they are also sometimes super curious about my low vision and white cane. Most of the time, I'm fine with it. As long as people are good-natured, it's usually fine. If I ever do become stressed out, I just remove myself. Neither my wife nor I are fond of crowds, so I don't often find myself dealing with uncomfortable personal space issues. The main thing I've found that helps, is to practice self care. If you get stressed out by these situations, it may help to find ways to relax a little (for me, it's usually Peloton or Netflix). Talk things out with someone you feel comfortable discussing such matters with. You may have already considered this, but is it possible that people freak out when you get mad because it seems out of character? Like you're usually super calm, so when you raise your voice, it's a notable event.
I hope find a balance that works for you. Drunk people can be super annoying.
