Thank you for replying.
The cover is definitely attached to the wall fixing so there is no way of levering it off. From looking at instructions for similar ones online, that little hole should be a screw, but it's just flat. I wonder if the installers filled it with something.