Yeah I drilled out the spongey stuff then sanded the crap out of the hole entrances, stuffed the back of the hole with tissue then put proper filla in. It's drying nicely so I'll sand it down and paint over.
Also, my £49 Black & Decker has gone a bit wonky so two of the new holes were drilled...