I would take as lesson learned and let it be, and worry about bigger fish on the horizon.
If this was the only thing to worry about you've got a smashing builder but in reality there will no doubt be something more important to focus on coming up rather than trip yourself up with delays and...