Our society is way too tolerant of that kind of behavior. It's similar to how there are still occasional people wearing masks, even outdoors. It needs to become socially acceptable to tell people they're being paranoid and weird, in the same way they feel it's acceptable to tell others they're not paranoid enough.
Masks are a bit trickier, since some people are severely immunocompromised or have loved ones who are immunocompromised. If you are undergoing chemo, or your parent is on hospice care, it actually makes sense to keep wearing a mask everywhere, and doctors are encouraging this (not just to defend against COVID germs, but all germs).
But as for outside masks, I agree, it's just straight up unscientific. Especially when people are wearing flimsy cloth masks that do little to ward off COVID germs in the first place! Although I know some people keep them on outside if they're walking between buildings, just because it's easier than taking it on/off constantly.
So anyway, masks kind of fall into that category of "I ain't gonna judge if I don't know your exact situation."
But I agree, it would be nice to be able to tell my friends who are perfectly healthy with no at-risk loved ones, hey, you really don't need to keep wearing a mask outside for the rest of your life. Both because it's silly, and because it seems genuinely damaging to their mental health... I have a couple friends who still get anxious/upset when someone gets within 6 feet of them without a mask on, and it's just a needlessly stressful way to live that is taking a very, very serious toll on their mental health.
