OK, let's take away "money".
You're example of food, gems, shelter, spices etc etc must have a value yes?
Now if I were to barter with you and get what I need to survive would that be acceptable provided we had an equal value?
Now what would happen if I bartered with you. We agree on a deal...