where C is a 1x128x4 learnable tensor, with each row vector corresponding to the key for each head in the attention mechanism, and ϵ ij is a 1x1x4 tensor holding the logits for each head. The ϵ ij values for each head are then softmax normalized over all edges originating at node i to obtain the attention scores