I have to agree with everyone here. I went through the same process. My car was in primer when I got it, but the fender tag showed FY4 "Light Gold Metallic". I really went back and forth in my head, because that color is SO rare, and I thought it would be cool to have it 'original' (and to match the fender tag).
My bodywork guy finally got me to 'see the light'. He asked if the rest of my car matched the fender tag. Well, absolutely NOTHING else matched my fender tag, so he asked why I was so concerned about that one item. He pointed out that, for the expense and trouble, I better choose a color that I KNOW I will be happy with for many years. So I decided to use the Hemi Orange, which I've liked forever. And it is a color that was available on my car, and what I would have ordered in 1970.
You are lucky that you got to see a car in your potential color, before deciding. I never did find a picture of the Challenger in my original color. It's your choice, and your car. Go with your gut instinct, and choose something you will be happy with.
-Tom