The simple answer is “no”. You don’t share interests. You don’t feel safe in her home because of her brother. You don’t like spending time with her. This is not what goes on between good friends.
However, it’s important to understand that not all friendships are the same. There are levels of friendships.
Close Friends: A very few people become close, close friends. They are the people who share many of our interests and with whom we feel very comfortable and supported. Best friends share their dreams and their problems because they know they will be understood and supported.
Friendly but not Friends: Another kind of “friend” is someone we see often, like the woman you described, but who is not a person we would pick to be close to. Since you see each other a lot, it’s important to remain friendly without becoming close. Conversations are kept very general and polite. Such people don’t expect each other to spend time together outside of work hours. The person you described probably fits in this category.
Acquaintances – people we don’t really know well but are maybe friends of friends or people in the community we get to know because we bump into them regularly. These are the people we wave to politely or say “hello” to when we happen to see them. There is either no interest or no time to get to know them better. (Sometimes acquaintances do become friends if there is opportunity to spend time together but it isn’t expected.)
I hope you take a step back from this relationships. Be on the look out for someone you find more interesting and approachable. Really good friends are sometimes hard to find but it is definitely worth the effort.
I wish you well.