A bacterial infection called tuberculosis, or TB, may also damage the adrenal glands. TB usually affects the lungs. But it can also damage other parts of the body. In some cases, it can damage the adrenal glands. This can lead to Addison's disease. TB is more common in developing countries.