Thanks both for your replies.
Deluks - I did think of doing what you've suggested with fixing a board but my concern was that the walls have just been skimmed. Based on the depth of the skim, if I no-nails it to the wall wouldn't the downward force on the handrail cause the plaster to crack...