What you are describing is emotional blackmail. This guy is controlling you and isolating you. Lose him. Lose him now. Trust your instincts. This relationship isn’t a “relationship”. You are being used and abused. He is taking much too much of your time and your life. Normal relationships do not require a person to be on call 24/7.
You deserve so much better. Get yourself out of this and make yourself available for someone who doesn’t demand such exclusivity, who treats you with real respect, and where contact is enriching, not anxiety provoking.
If you find that separating from him is a terrible struggle for you, please consider seeing a therapist for a few sessions. A therapist can help you take better care of yourself and can help you extricate yourself from this toxic situation.
I wish you well.