Donia perhaps your baby's father should grow a backbone.....there is absolutely no reason you should be going through this.
I lived a very similar life. The best thing I did was get divorced and move on. You need to nip this in the bud.
What we do in life echoes in eternity.