Caulk will fill most gaps but more than say 3mm you should really use some filler as it does shrink a little.
Almost all brands can be over painted but don't sand very well. Squeeze in just enough and smooth with your finger. Viola!
Fill the crack first, paint later. Although if you're...