1. A video decoder with video enhancement using direct contrast enhancement in a spatial domain comprising: a transform circuit responsive to a decoder intrablock output for converting a decoded video intramacroblock output to a matrix of spatial domain coefficients; a storage device having the following stored thereon: an intramacroblock enhancement matrix having a corresponding matrix of elements; and an intermacroblock enhancement matrix having a corresponding matrix of elements; an intramacroblock multiplier circuit for combining the spatial domain coefficients with the corresponding intramacroblock enhancement matrix elements to provide enhanced spatial coefficients; an inverse transform circuit responsive to said intramacroblock multiplier circuit for converting said enhanced spatial coefficients to a temporal domain to generate an enhanced decoded intramacroblock output; and an intermacroblock multiplier circuit for combining spatial domain intermacroblock coefficients from an entropy decoder of the video decoder with the corresponding intermacroblock enhancement matrix elements to provide enhanced spatial coefficients to the inverse transform circuit of the video decoder.