To get rid of old sealant, its best to use a stanley knife and cut both edges, then try and grab a bit of the sealant at the corner, and pull, and it should come off.
When you say paint on your windows......., can you just clarify a bit more?, do you mean paint on the glass?, or paint on the frames?, are they wood, or PVC?