ɐkˈoːɹdɪŋ tʊ ɐ lˈɛdʒənd stˈɪl ɹᵻpˈiːɾᵻd ɪn ʌpstˈeɪt nˈuː jˈɔːɹk, vˈæn bjˈʊɹɹən lˈɔst dˈɑːlɚ fˈaɪv,zˈiəɹoʊzˈiəɹoʊ zˈiəɹoʊ, ænd wɪð ɪt, hɪz fˈɑːðɚz hˈoʊm lˈɪndɛnwəld, æz wˈɛl æz ɐ mˈɪstɹəs, ðə vˈɛɹi pˈɑːpjʊlɚɹ ᵻlˈiːnə "ɐmˈɛɹɪkə" vɛspˈuːtʃi, dᵻsˈɛndənt ʌv ˈæmɚɹˌɪɡoʊ vɛspˈuːtʃi, tə dʒˈɔːɹdʒ pˈæɹɪʃ ʌv ˈɑːɡdənzbˌɜːɡ, nˈuː jˈɔːɹk ɪn ɐ kˈɑːɹd ɡˈeɪm æt ðə lə ɹˈeɪ hoʊtˈɛl ɪn ˈɛvənz mˈɪlz, nˈuː jˈɔːɹk.
According to a legend still repeated in upstate New York, Van Buren lost $5,000, and with it, his father's home Lindenwald, as well as a mistress, the very popular Elena "America" Vespucci, descendant of Amerigo Vespucci, to George Parish of Ogdensburg, New York in a card game at the LeRay Hotel in Evans Mills, New York.