I know what you mean if you move them to much the plaster will crack, but plasterers usually skim quite thin at the boxes (almost flush to front) and even if you have to take the box out, as long as you are careful not to do to much damage you will have a nice flush recess for the box to go back...