What distance metric can I use for comparing image features in a nearest neighbour algorithm?
You can use the Structural Similarity Index (SSIM).
It's not a distance per se, but you can use it in this case.