People who are allergic to Xarelto should not use it. Signs of an allergic reaction include: Hives. Difficulty breathing. Swelling of the face, lips, tongue or throat. Immediately contact a health care provider if you experience an allergic reaction.