That white growth does look like it could be fungal activity from past damp. Possibly early dry rot mycelium or another wood-decaying fungus that’s since dried out. The fact that it’s brittle, chalky, and snaps easily suggests it’s inactive at the moment. Active rot usually feels soft, cottony...