They are used for 2 things:
1. To evolve units.
2. To boost experience gained when you combine.

You should save enough of each spirit so that you can evolve the units you want, and especially save any plat/black spirits you get as they are harder to come by.