Numerical Stability

When you implement softmax, cross-entropy, or a running average by hand, the naive formula overflows or loses precision on real inputs. The fixes are a small, reusable toolkit: subtract the max before exponentiating, work in log space with log-sum-exp, and accumulate carefully. ML-adjacent coding screens lean on this, because the candidate who writes exp of a large logit and gets inf has shipped a silent bug.