Regardless of how gentle your driving style is it needs to be sorted straight away. It's going to be an expensive and regrettable event if you do lose oil pressure.
Also be aware that all the swarf from any repair to the sump thread MUST be cleaned out of the sump. You can buy "flushing oil"...