There are plenty of plants that will come back every year, produce flowers and spread, thus out-competing the weeds.
A few off the top of my head:
- geranium
- toadflax
- foxglove
- strawberry ["wild"/alpine type]
- aquilegia
All of the above are not "fancy" and won't require too much caring for.