My only experience of this was with a stud wall that wasn't supposed to be load bearing, but due to settlement it was. When I removed the last vertical I was so scared I tied a rope to it and pulled it away from a short distance. There was a bit of a thump, but it turned out OK.