No, stick the grey wire from the controller into this terminal block (where the black is now - so it is connected to the white)..
View attachment 319793
And remove the cable to the thermostat completely.
Then as you say, the Hive back plate is (more or less) a straight swap.
Edit, didn't see
@CBW post above - this is an alternative suggestion!