With temperatures dropping to levels cooler than expected, the start of a long-lasting cold may mean the end of the growing season for farmers.