Bees are awesome; ours left of their own accord, but they didn't bother us. Might have been a different story if we'd waved our arms around and shrieked like girls.
I saw a neighbour cut down an active wasp nest in his garden with some tree loppers. That was a sight to behold - those wasps...