No one is exactly sure what causes agoraphobia. But it is usually started by panic disorder. Panic disorder is a type of anxiety disorder that causes panic attacks.