I would leave be to be honest, you didnt pick it up when you bought the property, so no point in having the fight now about it.
And you reference a neighbours deeds (is it your direct neighbour?) - have you checked your own deeds/plans to make sure no mistake on their plan etc - that should be...