Far from an expert here, but common sense says if the nut hs been "on and off a few times", replace the nut. Also I would say the roll pin should protude on at least 1 side as a secondary safety to keep the nut from backing off. Seems redundant but I don't see any other reason for it to be there.