If this comment is too long for you, just scroll down to the clearly identified conclusion.
I am reading this and I have some stuff to add. I do not think that everything there is a personal mental problem, but rather a personal reaction to some stimulus (just like some food might get you to throw up). I have had a terrible episode which led to, let's say, a depressive state for a year and which kind of started with noise problems (but that state might also be the result of a head-collision I got right after that, but that does not matter; read on). Let me talk about some of my relationships with noise.
I never really had problem with noise, or how I felt in any home I living with (and I've lived in a lot of places), until later.
I was clubbing a lot when I was a young adult (not that long ago -- just a couple of years). I had disco-tinnitus when coming back sometimes, but it was really a non-issue as it was not bothering me (for me it was the music still bouncing in my head) and it was resolving the next day. So it was a non-issue, at least for the short-term. Heck, I did not even know the word tinnitus. That was just normal for me (with my probably semi-erroneous justification that it was just sound still bouncing. I was not that wrong though).
I have had fleeting tinnitus (you know hearing a sound for a couple of seconds, then it stops) from time to time. Then again, I believe it is a non-issue and it was normal for me, and I think almost everyone does experience this.
I had a bad hit on one ear when I was in my adolescence by some high school bully (they were hitting literally everyone being behind the head in the school yard that day and one jerk psycho rushed and by "accidentally" hit my right ear!) That ear did grow two to three times the normal size for a couple of hours probably, and for an hour I was probably hearing sound like people turning their sheets in the classroom (was it only an audio illusion or I was experiencing temporary hyperacusis? Who knows? It makes this too long to be able to analyze). But all that resolved after a couple of hours. I still felt a little weird with that ear physically, but very mildly and it was really a non-issue in practice, but who knows its long term consequence (that and any other injuries we may have suffered).
I often joked I was mildly deaf, but really, I could listen to a lot of conversations at the same time, plus as I am in everything, was very sensitive to details when it came to listening to what is happening around me (let's blame my curiosity!).
So environment noise was really a non-issue almost all my life, except, if I can draw a parallel with you guys, I could say that at my previous apartment, some specific sounds could drive me crazy, mostly when I was hearing noise (e.g. people talking) that were resonating in the wall. It was really a specific kind of resonance/noise that I could not really stand (some it is nails on a chalkboard, for example, just imagine that constantly), especially that it was happening mostly only in my bedroom at bedtime when the downstairs neighbor would listen to TV, talk on the phone, etc. Without that, all was OK with me.
Then after two or three years in that first apartment with my girlfriend, I moved to a new apartment (which I bought the building, so harder to move, I was the owner). After even two or three days, with little noise around and how it was resonating, was kind of bringing me down, as I was wishing for total peace in my new home. I was not the only one complaining, though (so it was not entirely a personal issue), but let's say it was hurting me more than others.
Not only it was pissing me off, but some noises were really invasive! It was not internal noise, as if I was blocking my ears. I could almost hear total silence. If you are picky about details, I would say except internal noises that were not bothering me and were normal to me. I was not experiencing this elsewhere (e.g. at job) even if I tried hard to focus on all little noises. So for me, it was really the way it was "sounding" in that particular place.
By the way, I never listened to music that loud with headphones (yes I was clubbing a lot, but if I had headphones I could listen at a very low level. Same thing when I was listening to TV too). However, when searching how I could improve my home's acoustic properties (e.g. isolating wall), I looked in forums, etc. and finally understood what that word tinnitus was. I'd heard the word, and I did know a bit of the temporary phenomena I was experiencing and found normal. My dad told me about a mild sound he was sometimes hearing at night now, and the same with my girlfriend, but I did not really make the link between the word and phenomena until then. Anyway, that led me to listen to white noise which was supposed to help ease migraine, tinnitus, etc. I gave it a try, thought it could not hurt, and I might have listened to it too loud to cancel the noise around for extended period (yeah, my ears felt different a little after some of my listening session). That might not have helped, but then, let's not draw any conclusion; it is a hypothesis on my list that I, of course, cannot confirm.
So an irritating tinnitus then developed less than a month after moving and experiencing this noise irritation (irritating tinnitus = nightmare). I qualify it as irritating as I might have other internal sounds that enter into the tinnitus definition, but you know if you can almost never hear it and when you hear it it is an almost non-existent/non-intrusive background soft noise, then it is not a real issue in practice like Tinnitus with a big T. And along with this I developed more noise sensitivity (all might be related; if my ears/head got damaged some way, then I might experience multiple symptoms), hearing a simple fridge was not good for my headaches, etc.
Then the head-on collision. Then I felt so bad physically that I stopped everything (sports, jobs, etc.) and of course got sad/depressed. Especially that I thought this time, all this was not temporary and I could not tolerate this constantly. It lasted near a year at that level (a long and painful road which I will spare you the details of). As for tinnitus, it varied a lot during that year, but has now stabilized. Other symptoms are still present, but the intensity of the problem is not the same, I can live, joke around, works, and am back to playing sports.
Still, I am probably the new owner of an annoying frequency tinnitus which I wish would disappear sooner or later, but it does not sound good for that, so I have to live with it.
Conclusion: All this said, however, if a very particular place/stimulus is making you go out of your mind, why do we still endure it? Heck, some people here say they have endured for 20 years the noise at their job that they could not stand. That is a lot of time to endure something that maybe is really hurting you (and maybe others that you do not know!) Not everything is only a personal mental problem, you know.
Yes, I can understand why we do not act in a lot of situations even if we believe we should. But ask yourself that next time you feel bad because of something, until the problem evolves into a bigger problem, it is your life and it is your health.