Memory Loss?

I have always had a very limited memory of my childhood. When my wife and I compare notes or get into a discussion about it, she is always shocked by how little I remember. I also seem to have a bad memory in general.
I don't believe I suffered any serious physical or sexual abuse as a child, but I did have serious connection issues with parents and peers. Emotional trauma, pain, shame, anger, etc.

I'm wondering if there could be a connection between the PMO and memory loss. Has anybody here experienced anything similar? Has anyone experienced a return of childhood memories after a period of sobriety?