Too much milk can be harmful for your toddler. Drinking too much milk causes toddlers to take in more calories than they need. This can result in weight gain. Large amounts of breast milk or cow's milk may cause a toddler's body to not absorb enough iron.