Try some hydrochloric acid bro. We have used it in the past to get pavelock silocone off cobbles. Dont forget your gloves though.
Otherwise you may find your only option is to spin the buggers round. Red clay bricks tend to absorb surface colours pretty quick with only a little moisture in the...