That switch provides a permanent live to the boiler, it overrides programmer etc
Your internal controls will be causing the problem, that switch will keep boiler running 24hrs and only switch off when Boilers reached temperature
The idea of the switch is to allow servicing to be done...