A hissing noise as the water is pumped passed the spring diaphram. This is amplified in a nearby bedroom radiator.
I guess you can't mount a swing check valve to stop upwards gravity unless you create a dog leg in the piping so the valve in the right way up. Maybe the pump is not powerful enough?