Any process that modulates the frequency, rate or extent of cell differentiation, the process in which a relatively unspecialized cell acquires the specialized structural and/or functional features of an endocardial cushion cell.
regulation of endocardial cushion cell differentiation