I have a 750cfm vacuum Holley. I do not see any reason to go smaller that that. The vacuum secondaries keep you out of trouble from "over-carburation", anyway.
My Challenger has a very mild almost stock 440 (stock intake and exhaust manifolds, old real factory Magnum cam from a friend´s RT 383 Magnum, 1.6:1 roller rockers, AT and 3.23 gears). Easy to cruise on higways, good mileage (at least the same as what the magazines reported back in 1970 with similar 440/727/3.23 Challenger).