sure, mould spores are a real irritant, especially if you suffer from allergies, hay fever or have a lung problem.
Although it is quite rare, aspergillosis can cause real issues.
https://www.nhs.uk/conditions/aspergillosis/
wear a mask and dig the mould in. Spray with water to dampen the spores flying around.