Library/strategy for rotate & scale image alignment/registration
One option is keep all the edge points, or to identify key points (junctions, corner) on both images, and then perform a (semi-)rigid matching, such as Coherent Point Drift, which is robust to missing points. 

Further, you could split the biggest images into smaller overlapping patches, and adapt the template to the different patches.