wild plant next to wall

[Newby2]

I just found out there is a wild plant (shrub? don't know the name) next to the external brick wall of my house. It grows in the gap between the wall and the flowerbed boundary, so very very close to the brick wall. Its height is about 2cm above the ground and the stem diameter is about 1cm. This wild plant seems to be quite common as I also found a few at various places in my garden. Would like to know its name.

I have tried to remove it, but it proves to be difficult as it is in a small gap.
Shall I leave it, or should I be concerned as its further growth may damage the wall?

Thanks.