Sail is hiring for an engineering role in San Francisco to design and implement high-performance schedulers that optimize admission control, queuing, and fairness across a global fleet. You will also build LV routing systems to dispatch workloads with latency awareness and predictive autoscaling, and explore KV caching for memory/compute trade-offs in LLM inference stacks.
You will contribute to deep observability, tracing every millisecond and preemptively addressing failures before customers
#J-18808-Ljbffr
We invite applications for the Staff Engineer — AI Inference & Distributed Systems position located in San Francisco, CA, United States.
We appreciate your interest in this position.
Join Sail and contribute to our ongoing work.
Take a moment to read everything above and see whether this role is right for you.
This posting is for the Staff Engineer — AI Inference & Distributed Systems role at Sail, based in San Francisco, CA, United States.