I'd be a bit reluctant to leave that connector inside the cavity, even with an access panel. If something goes wrong with the phone line in a few years, you really don't want to be opening up a wall just to check a connection. I'd look into getting the box relocated to an accessible position...