If an NSAID caused your peptic ulcer, your health care provider may tell you to: Stop taking the NSAID. Reduce how much of the NSAID you take. Take additional medicine to reduce stomach acid. Switch to another medicine that won't cause ulcers.