At a young age, Ma began studying violin and piano and later viola, finally settling on the cello in 1960 at age four.
Ma studied at The Juilliard School at age 19 with Leonard Rose and attended Columbia University but dropped out.