The Witch’s Chimney in Wookey Hole contains the largest concentration of ritual protection marks so far discovered in any cave. These are described and the growth of the folk narrative of the Witch of Wookey Hole is examined to place the marks in their social context. A poem by James Jennings, The Mysteries of Mendip or the Lost Lady provides a possible link between Wookey Hole and Long Hole. This is examined and a possible origin for the practice of banishing ghosts to the Red Sea is suggested.