Wear gloves outside, obviously don't touch face, but carry a pack of tissues with you and when you feel the urge to scratch, blow nose etc, use the tissue as a barrier between your hands and your face, then dispose away from your person.
Then once you get home, remove gloves and wash hands...