Without a doubt, a light skin of dust will easily create a skin between the adhesive and the wall.
Similar situation to when you you place cellotape on the carpet, and pull it off, and then when you try to stick it back on, it doesn't have the same strength? Tile adhesive is not liquid, so it...