Do you have any mixer taps fitted somewhere in your house? It sounds like one might be letting the water through.
If you have a direct cylinder, the thermostat should be located on the immersion heater itself (under the plastic cover).
There won't be a visible thermostat strapped to the tank.