Pilonidal cysts may cause pain at the bottom of the spine, near the tailbone.