You can replace it with a dwarf variety of Lavender!
It wont ever grow more than 2 feet tall then.
Failig that there are any number of semi-evergreens / Perrenial shrubs that would do the job just as well in your type of soil, which is probably slightly alkaline.
Again The RHS website...