Design an inference batching service
Work through an interview question about serving AI requests while balancing latency, fairness, and GPU capacity.
Sat, Nov 1412:00 PM – 1:05 PM PST65 minutesLive online
Free workshopView workshop
One interview question. A complete design. Join a free live workshop to work through the requirements, decisions, and follow-ups.
Work through an interview question about serving AI requests while balancing latency, fairness, and GPU capacity.
Design a service that fills crossword grids with valid words, distributes the search across workers, and handles many puzzle requests at once.