yes, definitely concrete them in. I've tried the post holders and they are easier to use but don't give the same end result.
Also, put some chippings down in the hole for the post to sit on first before you throw the concrete in - this lessens the chance of the post being in constant damp...