Matrix multiplication
Each entry of the product is the dot product of one row of A with one column of B. Composing two linear maps this way is the single operation that dominates both training and inference cost, which is why hardware is designed around it.
- The left matrix, with shape m by n.
- The right matrix, with shape n by p.
- The shared inner dimension being summed over.