So, I've had two roofers round to look at it.
One said that it looked like it wasn't fixed in properly, and that he could re-seal it with sand and cement. The other one suggested adding an additional lead flashing on top of it. Not got a price for that yet, but maybe that sounds a bit overkill ?