Other than fever, symptoms of a kidney infection may include nausea, vomiting and back or side pain.