If I manage to solve the other problem, I suppose I could seal the pipe to the rest of the wall, with plaster or something, no?
@bernardgreen thanks for the suggestion - I’ll look into that.
The third option I can think of would be to try and drill at the back of the flue, but the mantelpiece...