Get the walls checked. A good gunsmith will then tell you if it's worth honing out a bit. This is the sort of thing I leave to the experts. Don't mess with barrels. You'll feel much safer/better the moment they give you the results which are normally it's fine..

T