AITA for saying my daughter’s friend’s dad “likes me”

I (53f) am a single mother and have a daughter, Rue (12f) who’s best friend Fay (12f) lives just a couple streets away in our neighborhood. Fay is at our house what feels like ever day, and they are very close, though I am not myself super close with Fay’s parents.

To spare you too much reading, let me highlight just a few key points I feel add needed context to this situation before getting into the comment in question.

-Fay is usually able to walk home from our house since she is close, but gets picked up by her mom or dad occasionally when weather is bad or they are going straight to cheer practice/ dinner/ an event etc.

-When Fay’s mother picks her up she will just pull up outside and send an “I’m here” text and wait for Fay to come out. This is also what all the other parents do.

-Fay’s father and I have only ever shared a couple texts between us (always about the girls) before all communication was changed to a group text with both him and Fay’s mom in it. He later told me in person “sorry, my wife just doesn’t like me texting other women without her.”

-One of the only other times I have talked to Fay’s father is when I ran into him at a school function and the talk turned to tennis. I mentioned “we should go play sometime” (as in take the girls to go play) and he responded with “yeah I bet you are great with balls.” Ew.

-When Fay’s father comes to pick her up, he does not wait outside and send a text like all the other parents. No, he walks into my house, silently, and stands there. Usually by the front of the living room, which is also where the entrance to my bedroom is. On multiple occasions I have walked out in my pajamas and been scared half to death by the man silently standing in my home. It’s disturbing. It makes me feel uncomfortable and honestly, unsafe. The most recent time this happened, I was in my pajamas and watching tv in my bedroom. I hear the door open but Rue and Fay were downstairs already. I hear him ask “is your mom home?” And Rue says yes, she’s in her room asleep. He says he doesn’t believe her, and I hear him walking towards my bedroom door saying “I’ll just check” before Rue tells him to wait and runs into my room, she whispers “hand me your phone” and runs back out with it saying “here, see, why would she be gone with her phone here?” He accepts this and leaves with Fay.

So, the day after this most recent event, I’m talking to one of my other daughters, Marie (28f) and while I’m telling her about this I make a comment “I guess he just likes me or something.” Not really clocking that Rue was near and listening. Today, Rue just out of the blue says “Fay’s dad doesn’t like you by the way” because she brought the comment up to Fay… Now I’m freaking out because I don’t know what kind of awkward tension or drama this will cause with Fay’s view of me and especially if it gets back to her parents. AITA for making the comment? Was it out of line enough to blow up or am I overthinking this entire thing and letting my anxiety get to me??

EDIT TO ADD: I do in fact have a lock on my front door. It is a code lock, the girls know it. It auto locks itself after a minute so the door is ALWAYS locket. I’m not sure if they have told the dad the code. I do know that on some occasions Fay has come down when she was not quite ready, let him in, and run back upstairs. He does not announce himself, he does not stay by the door. He gets let in and the silently floats his way over towards my room down the hall and stands there.