I had exactly the same situation and built right up to the boundary incorporating a passageway front to back with doors
You may lose a bit on the ground floor but you gain the max above
Check out the party wall act as you can build astride the boundary line and footings can overhang nextdoor...