As BAS has posted, sounds like the switch is the problem, isolate circuit and investigate the switch. Does sound like a broken conductor, that could be making contact when cold, then when power is offered heat expansion is breaking the contact.
If it's stays on for longer when left but a...