Are you holding him for sleeping? I think he's already take this as a habbit. So, you can run away.
On the otherhand, baby is growing fast, at a point that he/she can walk, they don't want you to hold anymore. Rather enjoy the time that you can hold them!!!!