1. A method for generating a three-dimensional (3D) model of an object, comprising: capturing a plurality of images of the object from a plurality of viewpoints, the images comprising a plurality of color images; generating a 3D model of the object from the images, the 3D model comprising a plurality of planar patches; for each patch of the planar patches: mapping a plurality of image regions of the plurality of images to the patch, each image region comprising at least one color vector; and computing, for each patch, at least one minimal color vector among the color vectors of the image regions mapped to the patch; generating a diffuse component of a bidirectional reflectance distribution function (BRDF) for each patch of planar patches of the 3D model in accordance with the at least one minimal color vector computed for each patch; and outputting the 3D model with the BRDF for each patch, the BRDF further comprising a specular component separate from the diffuse component.