I had Stan Baker's shop back bore a 20 gauge several years ago. It had very heavy barrels/hence crappy balance. Just as an experiment, I had .020 taken out of the barrels, leaving still around 30 thou wall thickness. Still didn't quite balance the gun, but it took 4-1/2 ounces off the barrels.

Watch your wall thickness, but back boring does remove weight.