35Build a system to manage GPU credits across companies with wildly different usage patterns▼hardOpenAI1 replies◆ premiumA reported OpenAI build that looks like billing and is actually a data-structure question in disguise: credit grants that expire, usage that must burn the right grant first, and balance queries at arbitrary times. The earliest-expiry-first invariant carries the whole problem.Open full answer →
29Implement a GPU credit calculator.▼mediumOpenAICoreWeave1 replies◆ premiumA reported OpenAI phone-screen exercise that looks trivial and is graded on edge cases: money-safe arithmetic, billing increments, unknown SKUs, and the clarifying questions you ask before typing.Open full answer →
28Design token-based metering and billing for an LLM product, and explain why it must be decoupled from the call path.▼hardOpenAIAnthropicSalesforce1 replies◆ premiumThe LLM billing round has three trapdoors: retries double-charging customers, metering latency leaking into inference, and month-end numbers that don't match the provider invoice. The design that survives all three is the answer.Open full answer →