In theory, replacing the back box is easy - in practice there can be snags.
If the wall is plaster on brick/block, the metal box will probably have been screwed in to the brick and filler used around the edges. With luck, the screw will come out without breaking, and a sharp knife around the...