Yes, I did when my son was a few months old. It is nice because it would not be easy to enjoy such romance when the baby grows older. The world would become three peoples' world.
However, I could still remember the night before my trip, I could not sleep. We then chatted and I told my husband that I could not sleep because I worried that in case we both die during the trip, who would take care of our son. Then I cried for a while (a bit silly). The next day when the plane took off, I held my husband's hand tightly and prayed that I must not die because I needed to take care of my son....
From that day onwards, we must bring along our son.