Thanks guys - Peaps, I think I'll remove it all. I want to get to the brickwork anyway to check for a cavity wall and I could repoint at the same time. The chimney was capped and the fireplace blocked with a wooden board - I cut a hole in the board to start venting it.
I'll go away and get it...