Montauk estate sells for $17M, sets new non-waterfront record — and its neighbor is still up for grabs