if you intend to remove the old tap, cut the olives off, polish the pipe and refit the new one, then buy a suitable 15 or 22mm speedfit cap. if your cans don't last long enough, at least you might be able to cap it while you nip out to find an electric pipe freezer :)
if you haven't done...