Hmm, you make a good point, but I would do it tastefully...
Given the age of the property I like keeping features, hence definitely keeping the door, but making a big effort to insulate, so we looking for some form of solid insulation board - like PIR insulation but less compressible...