Central limit theorem
Averages of independent samples become normally distributed as the sample grows, no matter what the original distribution looked like. The square root of n is why halving your error costs four times the data.
- The sample mean over n draws.
- The true mean.
- The true standard deviation.
- The standard normal distribution.