Hmmm, if the remaining paint is stubborn, I would prime the areas of bare plaster with thinned emulsion 20% water - then give the primed area a full coat of emulsion to bring it forward to the rest. You then have a uniform surface to fill edges/ridges and mabye consider 1000 grade lining paper...