Normal distribution
The bell curve: fully described by a mean and a spread, and the shape that sums of many independent effects converge to. Its log is a plain squared error, which is why Gaussian assumptions and L2 losses keep turning up together.
- The mean, where the curve is centred.
- The standard deviation, how wide it is.
- The exponential function.