It is a common case. My 99 always wants to sleep with my son and carry him. But my son doesn't like to follow her, it mades her very disappointed.
You don't have to be very upset. Just think of the good side that your baby has more people to love him. Think of your 99 as a back up person to take care of your baby as you never know if you can get a good maid or not. You know can't totally trust those maids in nowadays.