Not a lawyer but I would say yes.
However, I would give them every opportunity to have someone do it for them (at their expense) and make good. Do everything in writing or email (with receipt ) return the bricks to them if you do it
Better to negotiate as it can get nasty and you do have to live next door