You've already answered the by-pass question, although I would undo the brass cap until you can see the number 5, or maybe 4.
Does the boiler make a hissing noise before it shuts down?
Does the boiler make a hissing noise before it shuts down?
