Euclidean norm
The straight-line length of a vector, straight out of Pythagoras. It is the default meaning of "how big" for a vector, and the quantity that gradient clipping, weight decay and distance metrics are all written in terms of.
- The vector being measured.
- Its i-th component.
- The number of dimensions.