I believe all the speaker options were available in all the years. You could also get optional rear speakers.... 1 with mono (driver's side) or 2 with stereo, so the actual choices are:
Dash = 1 Speaker, Rear = 0 Speaker, Total = 1
Dash = 3 Speaker, Rear = 0 Speaker, Total = 3
Dash = 1 Speaker, Rear = 1 Speaker, Total = 2
Dash = 3 Speaker, Rear = 2 Speaker, Total = 5
I'm not sure if radio delete came with 0 speakers, it would make sense but I've never seen an original radio delete car with the original dash pad. Maybe someone who has one will chime in.
Note that the Rear Speaker fader for mono and stereo units is different and not easy to source, if you want it to be functional that is.
I believe the dash frame will support any of the speaker options, it was only the dash pads that were different.
If you are going for a factory correct restoration, the fender tag/build sheet will contain the radio options which will tell you what speakers your car would have had.