Well, I chipped some plaster away. Then some more... and more. Basically I chipped it all off! So it's pretty obvious that the bricks in the centre were added at a later date, but I'm unsure about removing them as the original brickwork looks weak.
If you look closely under the arch, you can...