Try a rag soaked in hot distilled vinegar, tape it onto a small area and leave for about half hour. This softens the mastic, then I suppose you could try a wire brush. I know this works on concrete, don't know if it would ruin your bricks though. I'm told paint thinners works too, but vinegar...