Derivative
The instantaneous rate of change: the slope of the line between two points on the curve as they slide together. Every gradient-based method is this quantity, generalised to many variables and computed in bulk.
- The function being differentiated.
- The shrinking gap between the two points.
- The value the ratio approaches as h goes to zero.