No you did nothing wrong just used a sub standard product.Adhesive and grout in one are not very good,its either one thing or the other and will always struggle to be both.
Was the wall surface dust?This won't help the adhesive so I always prime walls with acrylic primer.
I've used the...