To be honest, even shallow rooting vegetables require 12-18" of soil so I guess in your case it would be better to take the base out.
This article has a table of vegetable root depth.
http://eartheasy.com/raised-beds-soil-depth-requirements.html
If you choose to take the concrete out...