I son is 3.5 months old and also has the habit of suckling his right thumb recently (starting from his 3rd month). He did not cry for feeding but kept suckling his thumb when he is hungry. ...
My bb also suck his thumbs all the time. But I will let him suck, just to make sure that his hands are clean.
I also gave pacifier to my bb when he was one month old.