Any process that stops, prevents, or reduces the frequency, rate, or extent of CD4-positive, alpha-beta T cell differentiation.
negative regulation of CD4-positive, alpha beta T-lymphocyte differentiation