There is only 1 part of the house where a pipe goes underground, and now I think of it, the wall next to that pipe had always had a slight damp problem. It's in the utility room / garage which is next to the house, and is much colder than the house, so I just assumed this damp was an old problem...