If you do accidentally attack a Seed Bearer with a team that doesn't consist of a single 2* then you can just refresh the page. It will just show that you have done 0 damage and will take a raid point.

Doing that has saved me so many times. XD