39Design a backfill for an aggregate table that takes late and out-of-order events without double-counting or holes.▼hardDatabricksSnowflakePalantir1 replies◆ premiumThe aggregate-restatement problem that breaks naive backfills: events arrive days late and out of order, so any partition you already published may be wrong. The staff answer is event-time partitioning plus bounded restatement, not a bigger watermark.Open full answer →
43Build a streaming aggregation with exactly-once output, bounded state, and a defined policy for events that arrive an hour late.▼hardDatabricksSnowflakePalantir1 replies◆ premiumStreaming interviews separate people who have run a job at 3am from people who have read the docs. The hard parts are not the windowed aggregate, they are bounding state so the job does not die, and choosing what a late event does to an already-emitted result.Open full answer →