I may be wrong, but that looks to me as if it is the joint between the frame and the glazing bead.
The black gunk can be scraped out of the joint, and any surface muck can be cleaned off - No need for bleach, it's unlikely to be ingrained into the plastic.
If there is a build up of moisture...