If one room is colder than the others in the house, and the door is open, all the warm, moisture-laden air will condense its water load on any cold surfaces, which'll be your outhouse.
Also damp from the floor is possible, but if it's unheated and un-insulated, condensation would be my first...