There was an article in one of the mopar rags about a year ago with the same type of exhaust question. They used a completed Super Bee with a reasonably mild 440 and a 2.5 exhaust on it for the baseline. The swapped it out for the 3" system and power and torque went up, but not a huge amount. I think it was maybe 10 no more than 15 horsepower. Will you notice that much difference, probably not.
BTW, there is no such thing as just enough or good back pressure. Any back pressure can cause reversion which can contaminate the incoming charge.