If it goes off, and cannot be silenced by entering code, you will need to remove power from the panel, open the panel, remove battery then get ladder access to the bell box, open it and remove battery. (You could do this now to disable it.)
Or remove power from panel and listen to bell until...