I need advice too.
Since taking the photo, I've used a wire brush (attached to a drill) to clean the bricks and I've dug out most of the loose bits.
I spoke to a couple of electricians yesterday. One said he re-pointed his internal brick with ready mixed mortar from Wickes.
The other...