Dealing with "noisy" neighbors...

So, I got this problem with a neighbor of mine. Most of his girlfriends are kind of... loud. In the pre-nofap days that wouldn't bother me, we all know how we would deal with this, but now?

It is hard to describe what this makes me feel and it goes way past getting me aroused. I can't take it not because it makes me afraid of getting back to fapping, but because it's tormenting my soul. It's a combination of reminding me past times I was with a girlfriend, all the struggles I am having now to get one, feelings of inadequacy in that sector of life, bad luck...

One way to deal with it would be to sit and listen so the effects lessen eventually but this is too much for me. I can barely hold on if they just go at it for a few minutes but when this goes on for longer, it becomes excruciating. I either dash out of the house or hurry to wear some headphones.

Telling him to keep it down would be a douche move I think, plus I intent to pay him back whenever I am able too lol. It's not his fault this has these effects on me.

What's your take on this?