Thank you for writing. It looks to me like you lost some growing time due to some serious problems during your early 20s. You’ve been rebuilding your self-esteem and your self-confidence ever since. It is a very positive sign that the man who loves you continues to be there for you. It sounds like the rest of the family has problems of their own that get in the way of relating to you.
I don’t have enough to go on to determine if there is anything “wrong” with you. It could be that you are simply by nature an introvert. There’s nothing wrong with that. It could be that you developed some social anxiety in the wake of the hard breakup when you were younger. If that’s the case, some treatment would probably be helpful. It could be that your family members are socially unskilled themselves. If that’s the case, you will only have limited success connecting with them. It would be more satisfying to find other people who can be a family of the heart for you.
I applaud your efforts to learn about yourself and to connect with others even though it is difficult for you. I hope you will consider making an appointment to talk to a mental health professional who can hear your whole story and who can make the assessment I cannot make on the basis of a letter. You will probably come away from such an appointment reassured and with suggestions for how to work on social skills.
I wish you well.