I'm in a similar situation.

I was very popular in school and tons of girls asked me out. I went out with some, it never worked. Everyone only noticed my body and face, nobody my intellect. Ever.

So while girls seemed to like me, it was only superficial. Nobody ever liked my personality :^(