I agree that you should rather your baby 'chi' helper la. That means the helper is good to the baby.
On the other hand, I think it's parent's problem is the baby not 'chi' them lor. I had to work long hours when my son was small, 9am - 8pm. But my husband and I would spend all the time at home playing and taking care of my son, especially on weekends. He does 'chi' us a lot. In fact, he was fine to be taken care by dad, mom or helper. Which is really good.
Quality of time is more important than quantity of time.