You're not alone. I've always been most pleased when I find garments from a brand who sew them in after the seam has been sewn, so they can be easily unpicked.
Problem is, you cannot usually tell, which type they are, or whether they have the labels in or not, until you have them back home, then it's too late. Av last night, unpicked the seam stitch, to completely remove the label, then restitched it, for me, after finding that simply trimming the label simply didn't work.

