You can also thaw breast milk by heating a pan of water on the stove. Once the water is warm but not hot, remove the pan from the stove and put the container in the pan. Never heat the water to boiling or warm the container directly on the stove.