If you still stay at the company and have chance to be with him alone. Same thing MUST happen again especially you did not resist his kiss last time. Then kiss again, touch and then ....... It seems if he just wants to have body contact, i.e. sexual relationship wz you but not 'love'. If you want to take risk of external affair because your husband push you away, no one can stop you. Please bear in mind, start is easy,but ending will be difficult.
If you decided not to do anything against yr husband, never see this superior again. I don't think there is no other good superior in your new job. Good Luck!
Sorry I missed your last message. If he would leave, just let him leave. Who know the coming new superior is not a good one. Especially you are a mother, please be calm and don't do anything wrong to the family. It will be very painful to everyone.