Just make sure there's no way for them to get in or out and then the ones that are left in there will soon die - end of problem.
Make sure any venilation gaps are insect proof and seal up any other gaps with silicone (as a quick-fix). Check the mortar is still between the ridge tiles - if not...