I've had this before the draft is probably coming up through the drainage slots and behind the front seal the only place it can exit is the latch plate area I've solved it by gluing a piece of brush seal horizontally near the bottom of the frame to stop the draught rising on both sides hope this helps

