I've had a go with a scraper and an old chisel and it's bl**dy hard work!
I'm not sure whether it's the tile bottom or the latex adhesive thats left behind when the rest of the tile comes up. It's black, slightly foamy/rubbery and grips like hell.
Someone said use hot water to soften it...