Your post title probably sums it up, if the cavities aren't insulated, the mould patches are probably due to condensation damp, even with cavity insulation, damp can form behind wardrobes and the like. I would suggest
Don't put wardrobes against outside walls if you can avoid it
Ensure...