Low levels of testosterone affect a man's sex drive, physical features and mood. About 5 million American men have low testosterone. Low testosterone can be treated with hormone replacement therapy.