Taylor series
Rebuilds a function near a point from its derivatives there. Truncate after the first term and you have a linear approximation; after the second, a quadratic one — which is precisely what second-order optimisers are minimising.
- The point the expansion is centred on.
- The n-th derivative of f.
- n factorial, which keeps the terms from exploding.