1. A color processing method comprising: an obtaining step of obtaining shot image data and a shooting condition of the image data, the shooting condition containing white point data, exposure time data, ISO sensitivity data, and lens aperture data; a viewing condition setting step of setting a relative XYZ value related to a white point in an input side viewing condition based on the white point data obtained from the shooting condition, and setting a value related to adaptation luminance in the input side viewing condition based on the exposure time data, the ISO sensitivity data, and the lens aperture data contained in the shooting condition; a profile setting step of setting a profile based on the set relative XYZ value related to the white point; and a converting step of converting the shot image data, using the set profile, into XYZ data depending on the input side viewing condition, and converting the XYZ data, using the set relative XYZ value related to the white point in the input side viewing condition and the set value related to the adaptation luminance, into color appearance data independent from the input side viewing condition.