I’d knock it back with a wood chisel, if it’s quite bad you’ll risk the board breaking/bulging at that point. Not the end of the world tho either way.
Or if you’re on about the metal hanger itself, not much you can do other than a couple of whacks with lump hammer to flatten it up a bit