What could be the problem here is that the pan connector has a number of rings which make the seal in the soil pipe. If, once the pan connector is pushed into a position, if it is then pulled back out a bit the rings can distort inside the soil pipe losing the seal.
You could try pulling the...