Look at the native clover species like buffalo clover that were already here. White clover came over, yeah, but treating all clover like a single foreign plant misses the bigger picture. Some bees rely on the native types that evolved with them. Ripping out a whole patch without checking what's actually growing there can do real harm.
My buddy watched his neighbor do that last spring. It completely wiped out the clover patch the local bees loved. Even the guy felt bad when he realized.