Peptic ulcers often cause a dull or burning pain in your stomach. If left untreated, peptic ulcers can cause other, more serious health problems.