Rheumatic fever can develop after an untreated infection with strep bacteria. It can cause heart valve diseases when the body tries to fight the infection. Symptoms of heart valve damage often do not appear until many years later.