Its worth it and yes there is a big difference. Case in point was several years ago while I was at the Outer Banks. Had a Shrimp Boat offshore probably 800 yards out. Three people grabbed their binoculars. One has a set of Leupold 10 power, the other Bushness 10 power (10 x 40mm). The last person (me) grabbed a pair of Swarovski 7x50 (3 less in magnification). The only person who could make out the name of the boat at that distance was me with the Swarovski. They were that different.
Ditto on a deer stand this past weekend. Had a friend with Leupold 3x9 power in a box blind at 645 am and it was just breaking daylight. Doe came out, 8 point came out following the doe in a Rye field. At 75 yards he saw two blobs, one small, one big. The deer walked through the rye field. I was on the other end. 5 minutes later I saw the deer, saw clearly it was an 8 point and shot it. My Scope was a 3X9 Swarovski.
I look at high end optics as something special and something that you buy once and it lasts for 25 years unless you beat the hell out of it.