Hi, its difficult to tell what is going on without actually seeing this situation, but an alarm bell began to ring when you said ,"when you turned the heating on it began to rain in" It may be leaking hot flue gasses into the roof space.
Q, does the heating flue/chimney pass close to this...