Loss of your sense of smell could be caused by: A blockage in your nose. Allergies. Damage to the olfactory nerve. Deviated septum. Nasal polyps, which are small non-cancerous growths inside the nose.