Can someone plz give me some advice, I really need to let this out.?

You should get a restraining order on him. I know you said that wouldnt keep him away but the good thing about that is when he does come around all you need to do is call the police and he will be put away. Then you can have your girls to yourself