Coosa, you are not in the minority at all. I much prefer a relaxed pistol grip with double triggers, too. I know I usually shoot pistol grips better. No question.
As Lloyd said, with heavier loads I have much more control over the gun (think controlling the recoil and getting on the second shot faster). I have a straight gripped 32" AH Fox A grade made in Philly that I dearly wanted to be competitive with in registered sporting clays competition. It didn't happen. The control just wasn't always there for that second bird of a true pair. My hand moves up the grip towards the trigger guard under recoil, and I hate it.
I do shoot my straight gripped Dickinson .410 well, even with 3/4 oz. loads, but there's a big difference between a 3/4 oz. load and a 1 1/4 oz. load, concerning recoil and control.
If all I used a shotgun for was bird hunting where I never needed a quick second shot on flushing birds I'd probably be fine with a straight grip. They are elegant in appearance. But, when it comes to shotgunning I hate missing. So for me, pretty is as pretty does in this matter.