Spinal synovial cysts can form when the facet joints are damaged. This damage is often caused by certain diseases, such as arthritis.