Well blow me. I worked it out.
It's fussy about the "type" of battery!
After you mentioning the batteries on here, I did a bit of digging online (I don't have the original manual for the stat anymore, only the boiler) and found stuff referring to it only working with alkaline batteries above a...