Stop worrying about it; as Nige F said it's just an under-fired brick. No point in taking the adjacent joist out eithr just to get at it. Leave it alone; if it crumbles away completely, the house won't fall down.
Thank heavens for that, I almost started to look for that bottle of Dettol!
there are some
