I turned the boiler on and this time stayed near it to see what would happen. After about 30 minutes I noticed it was making clicking noises, spaced a few seconds about and then shortly afterwards there was a bang, and then a burning electrics smell.
I contacted the boiler repair people...