The process in which a relatively unspecialized epithelial cell becomes a more specialized epithelial cell of the mammary gland alveolus.
epithelial cell differentiation involved in mammary gland alveolus development