Yes, it would, my old sill was very similar to yours underneath.
I used a hammer chisel and chipped away all the plaster and cement bit by bit. Its not difficult, just take your time and nibble away (NOT one big hit) and always aim the chisel laterally, that is along the wall not towards the...