The back wall? It's only about 2ft high (and victorian, and not especially sound) - I doubt it would support a 4" 6ft post & fence.
If you mean the side walls then that's my plan for the 5ft wall on the right hand side in the pic, but for the other side?