Should I keep writing down my sexual experiences?

Some 5 to 6 years ago, my wife told me that when I'm depressed I tend to forget all the great sex we had some days ago. So, in all good intent, I started a sex journal: every time we had a great sexual and loving moment, I wrote briefly the following day what we have done the night before.

The problem is, it's really really arousing and it almost always excite me to the point where I masturbate on the memory of the night before. It never seemed a problem to me because in those moment I don't turn to porn, I'm just so aroused by what we did that I feel like masturbating.

It never struck me as a relapse, because I didn't turn to porn, and I only wrote them every once in a while, so it wasn't a invasive practice like the "classic" PMO structure. But... It's always the following day after we had sex, so it's pretty much a Chaser Effect.

Should I consider this a relapse or is this some kind of gray area?

Some part of me want to blame me for masturbating, period. But Blaming myself is the path to really relapsing...
And some part of me believe that this is OK because I masturbate only to the memory of my wife and I, not to some random porn, and only the day after we had sex.

Does anyone had the same dilemma?

 

Sorry for the artificial "up", I was wondering if anyone could help me with this.