Overexposure to heat, toxins, and chemicals can lower the number of sperm made in the body. It can also make sperm less healthy. Some examples include: Heavy metal, such as lead. Industrial chemicals, such as pesticides. Radiation or x-rays.