This is going to be long but I'm not sure of a simple way to say this without offending you, so bear with me. This is probably the one thing that most non-masons don't understand, even those with perfectly good intentions:
Freemasons don't invite anyone to join. You must ask to become a member. Inviting is just not done - its a major taboo and completely disregards one of the pillars of masonic philosophy (that candidates seek masonry of their own free will and accord). In some jurisdictions they even have a tradition where a potential candidate must ask and be denied three times before being given a petition. Its not just a tradition thing either, its a practical impossibility. You can't just be "invited" and be initiated. You have to be voted on, your background investigated, and interviewed. At any time and at any point, it takes 1 freemason to halt everything and stop you from joining. And 99% of masons would be that 1 person if they saw any indication that you were "invited."
The only exception to this is people who are made "honorary" masons using the "make a mason by sight" powers that most Grand Masters have, but the number of times that power has been used could probably be counted on two hands. The only recent one I'm aware of is Ronald Reagen, and that was a long time ago. Then, such people are invited, as making people honorary masons by sight without their consent would be rather rude.
What people almost always mistake for invitations to become a member are instead invitations to take a tour of the lodge, come to a lodge dinner, or participate in some community event. You might be invited to learn more about the lodge and its members. If anyone ever "invites" you to join explicitly, they are almost certainly not a regular masonic body or the member in question has lost his mind. We have lots of fakemason groups that pretend to be real freemasons (why they do that is beyond me, it just isn't THAT special...).
I'm not trying to say you aren't being truthful about what you perceived whenever you thought this person invited you, but the two main possibilities is that it was a invitation to an event (not to join) or a non-masonic group that was trying to be fakemasons.