I had much better luck with the crabs. Only got the memory game once.
I sit a bit back and let my eyes unfocus a tiny bit. Sometimes I end up getting two mixed, but I can keep track of three crabs at a time this way so it still works. It's certainly not super easy, and when I go down it's almost always in round ten, which is frustrating.