Well so long as the bearing will go on, technically you are good. You could try and do some filing but to be honest it is probably not worth it. Replacement is probably your best course of action. So, if you replace it you will need new ball joints as well, might be a good time for a front end rebuild across the board. If this isn't feasible (money, time, experience) then just do the one side and you should be good.