Thanks, yes, I turned it off before starting to remove the ceiling light.
It doesn't seem to be possible to push it any further in terms of pushing it all the way, there appears to be only two positions, on/off, it's definitely off but wont go back to on?