Yes, the handheld thermostat has the batteries and it works. So batteries are OK.
Yes, I followed this guide. Relay box doesn't have the lights at all. So "until the red LED blinks rapidly" - never happens.
Contacted the electrician, because I believe there may be some power issues with the...