I would say it's more listening to someone's conversation that you are not a part of. For example if you're hanging around outside an office listening on the sly, then you could be said to be earwigging.
I wouldn't consider it earwigging if someone is just sitting silently and listening. I suppose it comes down to whether the people having the conversation are aware that you're listening.