It took me a few moments before I realized: "Oh. That's how it works." I'm so glad the game has a Recall Spirit key, otherwise it would have been painful to play.