Well, I did more searching and found a picture of how the window would roughly be constructed, and it makes more sense now.
So that gap pictured on the outside indeed shouldn't be there, and the windows weren't installed correctly all those years ago. The question is, how do I go about...