1. A method comprising using at least one hardware processor for: dividing a medical image into multiple patches; computing a patch distinctiveness score for each of the multiple patches of the medical image; computing a shape distinctiveness score for each of multiple regions of the medical image; and computing a saliency map of the medical image, by combining the patch distinctiveness score and the shape distinctiveness score, wherein said combining of the patch distinctiveness score and the shape distinctiveness score comprises: decomposing the medical image to connected components based on the shape distinctiveness scores of the multiple regions, and in each connected component, multiplying the patch distinctiveness score at the location of the maximal shape distinctiveness score by a Gaussian.