1. A computer-implemented method comprising: pre-processing a coronary angiography sequence of images, the images depicted in an image frame, the pre-processing including: detecting and labeling regions of interest in at least a subset of images of the sequence, wherein the region of interest contains a coronary vessel; estimating shape and motion in at least the subset of images of the image sequence, including extracting centerline curves of coronary vessels and computing optical flow within an angiogram sequence; sampling the extracted centerline curves to generate feature points; sampling a surrounding region of the generated feature points to capture shape and motion context of a depicted vessel; forming a feature set for classification of the depicted vessel, wherein features are constructed from pyramid histograms of shape and motion context; building a first pyramid histogram representation of a shape of the vessel shape and a second pyramid histogram representation of motion of the vessel; and forming a matrix from combined shape and motion vectors, a first dimension in the matrix corresponding to features at each keypoint and a second dimension representing one aspect of the shape context or one aspect of the motion context; determining a set of characteristics separating data in feature space, where the feature set is derived from pyramid histograms of the samplings, and employs angiogram sequences with known viewpoint labels; and returning a classification result for a new sequence of images based on a recognized shape and motion of the vessel, including labeling the new sequence of images.