Vinegar is not an accurate test. Lime plasticiser or natural carbonates in the mix can cause it to fiz. If you need to know for sure it should be laboratory tested.
Generally, a grey shade would tend to indicate cement, as would a finer, denser grain appearance and it being harder and pieces...