Drill into the clay collar, every couple of ins, and CAREFULLY chip the collar away using a chisel, making sure you don't damage the old loo, as you don't want any loose bits falling down into the soil pipe.
Also be careful when lifting the loo out. You may want to use an old plastic...