Drinking lots of water is usually healthy. But drinking too much water may cause water intoxication. It can happen to a baby if he or she is fed tap water instead of formula or a balanced electrolyte solution like Pedialyte .