Explained definition of the norm in Ordinary Least Squares
The norm indicates the Eucleadan norm, which gives the ordinary distance between the points.
https://en.wikipedia.org/wiki/Norm_(mathematics)

The subscript 2 with norm sign indicates "square root of the sum of squares".
The superscript 2 indicates sign power.