If I were you, I would just get smaller tyres. If they still rub, roll the guards. If you don't care about the speedo, just roll.
It really depends if you like the wheels or not. Do you regret buying them? If you do, then maybe try a new set of wheels.