Even we, parents, can't enjoy (or even complain) a holiday tour if we have to take care of a young kid (especially BB) all the way.
Then, do you believe that your maid won't complain (or doesn't know about that)?
Also, the medical system is quite poor over there. In case (touch wooed) your BB gets sick, do you have confidence that your maid can take care your BB?
Think it this way, would you worry about your boss's workload if you are on vacation? Do you like to take your work with you while you are on vacation?