So I checked the bulb was in correctly, checked the dimples, everything seems correctly in place.
Yes it does have a dusk-dawn dial, when I checked the bulb, I changed the setting to see if it was working (was still a bit light out) it lighted up fine, without any flickering. Then checked on it...