🌐 Self-attention is a mechanism used in Supernet to capture dependencies and relationships within input sequences. It allows the model to identify and weigh the importance of different parts of the input sequence by attending to itself.