Check the pipe from servo to pump, it may have a small pipe branching off it, sometimes used to operate heater controls or whatever, you may have a leak there.
Also while doing the test described above, holding the pedal start the engine and then increase the revs, see if the pedal moves at all, a worn pump may produce more vacuum at higher revs