You can thaw the milk by putting it in the refrigerator overnight. If you need it sooner, you can hold the container of frozen milk under lukewarm running water. You can also set the container in warm or lukewarm water.