Same here! I drink milk tea few times a week too and feel happier :) Don't feel guilty, it's ok.
But if your baby doesn't sleep well, maybe you can drink less coffee as the caffaine will go to her through the breastmilk and maybe that's why she's awake till late?