.......And check for visual smoke before putting the probe in.
Any idea which make and model of burner is fitted. With that pump, my guess would be a Sterling, which has rubber drive dog between motor and pump. The nylon drive dogs wear on that burner and cause noises like you describe.