Dont' think too much, everything will be just fine.
Just remember, your emotional feelings have affect on your baby. I was like you when I had my daughter few years ago, turned out everyting is fine but my daughter's temper is awful. If your child's emotional is like that, your life and your child's life will be miserable. just relax and tell your husbund how you feel. He'll understand :>