I fully understand. Not because you are forgetful but you need to take care of a small BB and a lot of other things at one time. I also got the similar experience as you did.
So I bought a big bag with me wherever I go. After shopping in supermarket, I put all the coins, things and cards back to the big bag.