When I first gave up, it did bother me to be near someone who smokes, but it doesn't now. My missus still smokes, albeit not half as many as she used to. I am asked if I find it more difficult with her smoking, but I don't go outside to smoke with her any more, so no.
I must say though, that...