loopprep

Load Balancer

total 00:00
Hard48 minPremium Asked at Scale AI

    The dispatcher in front of a pool of workers: queue tasks, hand them to the worker with the most room, respect priorities and capacities, notice when a worker goes silent and requeue its work, and stay fast at twenty thousand workers.

    The five steps
    1. Workers and tasks 9 min
    2. Priority first 8 min
    3. Room on each worker 10 min
    4. Silent workers 10 min
    5. Twenty thousand workers 11 min