Memory Loss

I had a conversation with Joy before our meditation group meditation time about memory loss I was having. I mentioned having to use a search engine to jar my memory about the name of the person I was thinking of (this time it was Mitt Romney).  She said I had mentioned it more often lately. I wasn't sure if I had or not, but what she said makes sense.  I don't feel like I'm in depression at this time. Before when I was suffering from depression I seemed to have more memory loss and mental fog. My Mom is having memory loss, forgets conversations we've had.  Her uncle had alzheimers and her aunt had memory issues, although I think that appeared later in life. Not sure how relevant that is. I remember once she had mentioned calling Aunt Rosemary. My Mom had to tell her that Aunt Rosemary had passed away a number of years before that.
I get frustrated at times with not being able to recall certain memories or thoughts I feel like I should be able to. Some people say it's just because I'm getting older now, but I'm not so sure.  I feel like I'm just being blown off when I mention that. I feel concerned and frustrated over it.