The highest risk are things like pipe lagging and other insulation which was sprayed on - any damage to that and it crumbles away to dust.
Woven or spun matting type insulation is also high risk, as the fibres are not enclosed.
Boards, corrugated sheets and other solid building products are very low risk as the asbestos fibres are held together by the cement or other materials used in them.
The problems occur when they are cut, drilled, sanded or similar as that is what separates the asbestos from the rest of the materials.