Are you planning on creating a temp office space?
Personally I'd suggest temporarily using some board type insulation, celotex or kingspan, cut around the beams and stuck up with some strong glue.
4 inches of kingspan is pretty close to 8 inches of normal rockwool. It'll be alot better than plaster board and a couple of inches of rockwool. And would probably be reasonably easy to put back to standard after.