The slabs will be at risk from weather induced ground movements and hence ditto the wall. However since you would need to have foundations at 600mm plus it doesn't make sense to go to such cost/extremes for such a structure, so yes it is prudent to build off your slabs but dont expect it to stay...