I found this doing a google search
"Old lady" in this sense is a baby-boomer word. When I was young, "my old lady" did indeed mean one's mother. It came into its present use gradually, as boomers grew old enough to think of their girlfriends as women.
GenJen54 is close enough in her etymology...