Other than fever, symptoms of a kidney infection include nausea, vomiting and back or side pain.