This leaflet suggest 100mm / 4" of granular fill above and below pipe, so you won't need a huge amount of pea shingle: https://idoc.pub/documents/wickes-underground-drainage-1d4795y0w7l2
If drain is old clay pipe and there is a joint under your new wall, take care. It's easy for joint to start...