How to recognize colors from the color chart?
You can house hough lines to detect the color area


First detect all lines
Lines with longest length would be the outer most ones
Pick the top horizontal line and do template match for the squares.
Once you find the squares, traverse downwards toll you reach the other set of squares.
Mark all points where the squares were found
You now have an enclosing area for the color chart.