If the pad is glued on, I would not pry or try to break it off. You risk chipping out the side of the stock. Since you're going to replace the pad, I would saw the pad at the rubber/plastic line or close to it, then find out if there are screws in it, remove if present, then sand the rest off with a disk sander. This will save you from a big boo boo.