Thank you for the replies.
It seems there is no definitive answer.
The only thing I can think is that by removing it all, we can't be doing anything bad. If we leave the old insulation and boards, there maybe draughts between the insulation and boards, and that can't help. This might...