1. A method for detecting defective pixels in a video sequence having a plurality of frames, the method comprising: determining one or more frames of a single scene and determining a plurality of buffers of each frame related to the single scene, wherein each buffer consists of a matrix of pixels; detecting one or more candidate pixels for a first predefined number of frames, the steps comprising of: calculating a presence count for each pixel of each buffer; calculating an edge count for each pixel of each buffer; and storing a pixel location of a pixel as a candidate pixel if cumulative difference between the presence count and the edge count for pixels in the first predefined number of frames is greater than a predefined first threshold; tracking the detected one or more candidate pixels for a second predetermined number of frames, the steps comprising of: setting a candidate flag of each of the one or more candidate pixels based on the presence count and edge count of the one or more candidate pixels; setting a motion area flag of each of the one or more candidate pixels based on a count of motion pixels in the neighborhood of the candidate, wherein the neighborhood is of a predetermined size; and calculating a minimum pixel value and a maximum pixel value for each candidate pixel and each pixel in the neighborhood of each of the candidate pixels in the second predetermined number of frames; and, validating the one or more candidate pixels for presence of defect, the steps comprising of: determining a defective behavior flag of each of the one or more candidate pixels based on the candidate flag and the motion area flag of each of the one or more candidate pixels; determining a sum of the candidate flag and a sum of the motion area flag for each of the one or more candidate pixels over all the second predetermined number of frames; and marking a candidate pixel from the one or more candidate pixels as a defective pixel on one or more predefined conditions.