Certain genetic diseases cause low testosterone. Abnormalities in chromosomes, the genetic materials of the body, cause genetic diseases. For example, myotonic dystrophy causes testicular failure between the ages of 30 and 40.