1. A method for fusion of multi-modal images, comprising: receiving a first image acquired using a first imaging modality; receiving a second image acquired using a second imaging modality; and jointly estimating a model and of a target anatomical structure and a transformation from the first and second images.