Before I put my bearing on, I took a Roloc fine grit on my pnuematic air tool and sanded it all over.
Then after that, I took a finer grit sand paper and sanded till it was smooth.
Slid the bearing on, and was done without any effort sliding it up into place.