Whether your looking for simple shootable condition or aesthetics, you should at least get it removed. Personally, I'd raise the dent, have the outside struck as well as possible, and have them reblacked.
Some may tell you that they can remove a dent, almost invisibly, and perhaps so, but I can't, and have yet to run across one done by others that I couldn't spot some hammer marks. Removal without the hammer generally leads to a bulge. In the case you describe, a good bit of tapping will be in order.
Jim