Owner of 175-year-old farm left in ‘shock’ as New Jersey town wants to seize his land for affordable housing