Damage to the cells of the testes can cause low testosterone. This kind of damage can be a result of Accidents Inflammation of the testicles Testicular cancer Radiation therapy or chemotherapy used to treat testicular cancer