A cyst is an abnormal pocket of pus or fluid. A pilonidal cyst forms near the tailbone at the top of the crease of the buttocks. The tailbone is the small bone at the bottom of your backbone, or spine.