1. A method comprising: pre-processing a coronary angiography sequence of images, the images depicted in an image frame, the pre-processing including: detecting and labeling regions of interest in at least a subset of images of the sequence, wherein the region of interest contains a coronary vessel; estimating shape and motion in at least the subset of images of the image sequence, including extracting centerline curves of coronary vessels and computing optical flow within an angiogram sequence; sampling the extracted centerline curves to generate feature points; sampling a surrounding region of the generated feature points to capture shape and motion context of a depicted vessel; and forming a feature set for classification of the depicted vessel, wherein features are constructed from pyramid histograms of shape and motion context; and determining a set of characteristics separating data in feature space, where the feature set is derived from pyramid histograms of the samplings, and employs angiogram sequences with known viewpoint labels; and returning a classification result for a new sequence of images based on a recognized shape and motion of the vessel, including labeling the new sequence of images.