I don't think it's cold. It gets warm in your stomach anyway. I have eaten yogurt from day 1 until I delivered my baby. If you worried about it, you can take some calcium tablets from your doctor.
But I think yogurt also has various kind of good bacteria other than calcium. I didn't experience constipation (bin bei) during my whole pregnancy.