This took me a bit to figure out, but you need all five. Each one from a stage within an act. It will say which stage you've gotten the key from. I noticed that the more you play the stage, the bars around the stage selection begin to fill up to show it's more likely to get a key because once you acquire a key it resets.