Your model scored 0.94 offline because a column knew the future

Models in customer environments fail on data, not algorithms, and the specific failure is leakage: a feature that would not have been available at prediction time. Building features as of a point in time, and splitting by time rather than at random, is most of what separates an offline number from a production one.

16 MIN · PREMIUM