You can still do it, even with the pipe there, it will just be a bit more awkward.
Maybe put some plastic sleeving over the pipe, then pepper it with an sds. I did a complete doorway this way (took bloody ages !)
Don't try and fill with cement, it'll fall out as soon as the frost gets it.