In response to oilman:
The noise is constant (never stops) when the HW is on. The moment I turn it off, the noise stops. It could therefore only be making a noise when it is heating, something I hadn't thought of (this is my first house and I'm therefore new to diy!).
There isn't a...