How about drilling in from outside, starting slightly lower than the level of the fan, and going up into the shaft of the existing ventilation gap from below? Would that work? Slightly hard to describe without a diagram -- let me know if you have no idea what I mean, and I'll draw one.
EDIT...