According to my doctor, for babies before 1 year old, from 38°C (anal) onwards, you must give medicine to baby. Moreover, don't forget to make your baby drink more water and not to wear too many clothes.
If the fever continues, you may bathe your baby in water at 37°C - not more than 10 minutes.