1. A spatial domain video enhancement/up-scaling system comprising: a first stage including a K×K transform circuit for transforming the video input from the temporal domain to spatial domain coefficients; a multiplier for multiplying each spatial domain coefficient by corresponding elements of a K×K enhanced matrix to obtain enhancement spatial domain coefficients and depositing them in the upper left K×K corner of a zero padded 2K×2K inverse transform matrix; a 2K×2K inverse transform circuit to scale the enhanced spatial domain coefficient and convert them back to temporal domain elements.