The pilot light wouldn't stay on at all when the button was released, but boiler still sounded as though the heating was on, even though the selector switch was turned to HW only, so shouldn't have been so loud. Alpha instructions say to turn the gas valve to off pilot light won't stay on, but...