Infections should be reported right away. Signs of infection at the injection site are:  Fever or chills Irritation or burning at the site of injection Redness or swelling at the injection site Pain Skin that is warm to the touch Drainage