100% agree, super dirty. even he wears condom it's still unacceptable!
If I were 樓主,I will take the baby away & divorce immediately. No 2nd chance should be given because he lets his sexual desire overriding his love/care (if any) for u & baby. That means he is an animal rather than human being la. Human being should have discipline to control himself. Although I understand most male fall under animal category - no offense to anyone but it's an undeniable fact.
Although life will become very very tough for u (not sure if u have high earning power, but u definitely hv to work & raise the baby on ur own), but i think it's important to stand up for ur own dignity as a human being and as a female.
Since u only started a family with ur husband NOW, and he's already being unfaithful. If u can accept, tolerate and forgive him this time, then I can assure u - this is only the beginning of ur hell life. Not scaring u.
Can't you try not to rely on your husband? Go find a job yourself! You are still young (i guess) and have a long way to go in your life. No pain no gain! Short pain is better than long pain!