I get that you have a pre existing condition but remember that masks don't protect you. They protect other people as you've said you do.For me it is more than an inconvenience. I have COPD and the mask makes it harder to breathe when I am at the gym exercising or even just bowling in my old guys league. I still wear a mask in all businesses and anywhere it is required to help protect other people. It is much easier to breathe when I get to take it off. Pretty sure I don't want to wear one every fall winter. I will rely on the flu shot.
I also can't recognize people with masks and can't tell when someone is smiling or frowning.
When Grunts showed me that something like 20% of all flu cases are asymptomatic it was enough to convince me that this should just be part of how we treat each other.