Assuming you have wired it correctly, it could be water in the switch (water having run down the drop cable). If the light wasn't on until you switched it on, but then it stayed on when you switched it off it could be there was water on the contacts, then when you switched off a droplet bridged...