Your mortar has dried out before the cement has had a chance to cure, because of the very hot conditions when you laid the slabs, as you have said.
No way to fix it other than to lift them up and lay again on fresh mortar, I'm afraid.
The grouting needs to be a wet mix when applied, 'a...