A very common infection in infants and newborns is oral thrush. Oral thrush is caused by an overgrowth of yeast in and around an infant's mouth.