Facial recognition architecture
Have a look at a few networks:
-Siamese Network
-One-Shot Learning Model

Once going through these models you will understand how they can very well with very limited amounts of data.