Try using a stiff, clean wallpaper scraper. Worked fine for me as if you apply enough pressure and push the scraper along slowly, the grout just rolls itself up in front of the scraper. When you have shifted as much as you can, use a wet coarse cloth to finish off.