I fixed it!
For folk with the same tap, what I did was get a reciperocal saw and cut a notch into the cap and then use a screw driver to move it and then unscrewed it, the rest was easy.
What a badly designed tap cover, it IS impossible to remove, unless you cut a hole in it to allow it to be...