"I'm sure a lot has to with my bench technique and shooting arrangement as well. I also notice that you shoot with your barrel up against the forearm. Another thing to try."
My first fifteen years learning the Schuetzen rifle was on my home range behind the house. One summer I spent doing nothing but resting the forend or barrel in about every position possible including a sled.
What I came away from all this was I shoot the rifle better with the barrel on a hard (called brick bag sometimes) bag with the forend just touching. I don't believe this does anything other than making sure the rifle is in the same position EVERY-TIME.
To get good results everything you do from loading to how you hold the rifle must be the same each and every time.
In my experience a single-shot rifle shooting a jacketed bullet shoots better off the forearm. All lead bullet rifle I always test both was and end up on the barrel.