While working at the record store Village Oldies on Bleecker Street in New York, Kaye met poet-singer Patti Smith.
In 1995, he reunited with Patti Smith and has been a part of her band since, creating five studio albums, a retrospective, and celebrating the thirtieth anniversary release of their landmark debut album, Horses [REF].