What brand of fiber cushion wad are you using and how do you lube it? If they are circle fly, I would try something else. Precision Reloading has their own house brand which is much better than Circle Fly. Ballistic Products also has some other options, but there is not a lot of variety out there.
I would try 2 nitro cards, also.
How do you seal the ends?
Last, someone here, long ago, suggested using a paper wrap around the shot. I use some water color art paper which is thick and will easily and greatly reduce barrel scrubbing by the shot which gives fewer fliers.