are you accidently earthing out the neutral?
say, for example touching the neutral cable agaisnt the earth while you're working?
or even with a screwdriver accidently touching the neutral whilst against the metal back box, or ......
I always tape off the neutral and earth whilst doing...