For building a team, when choosing sub weapons is it better to use your strongest weapons regardless of element (usually a load of max'ed out SSR weapons) for the raw att/hp stat or is it better to go for mono-element weapons that match your team to stack the passive effects but sacrifice the raw att/hp stats?

I've always done the first option so whenever I had another weapon that shared an element to one I already have I would keep the highest rarity one or if the same rarity, the one I would most likely get to the highest total power when including likelihood of being able to break it and its max base stats from the library section.
Have I been foolishly getting rid of these similar weapons for upgrade materials or is raw stat power better?