How is defense actually calculated?

I am a specialty player.

For some reason my charm defense is higher when using a team of Bunny, Princess Agate, and Red Battler than using Bunny, Agate, and Juliette, even though Juliette's Charm bonus is much higher than Red Battler's.