loopprep

Durable Work Queue

total 00:00
Hard48 minPremium Asked at OpenAI

    The work queue behind a task system: hand tasks out in order, fence each reservation with a token, retry within a budget, expire leases that go silent, hold tasks behind their dependencies, and stay fast at twenty thousand tasks.

    The five steps
    1. Hand tasks out in order 8 min
    2. Retries and the dead-letter queue 9 min
    3. Leases that expire 10 min
    4. Tasks that wait on others 11 min
    5. Twenty thousand tasks 10 min