Baseten is hiring an inference performance engineer to accelerate AI workloads across the inference stack, from runtime internals to scheduling and routing. You will apply techniques like prefill, speculative decoding, and KV-cache management, shaping how fast customers' models run in production.
The role requires strong GPU knowledge, experience with PyTorch and TensorRT, and the ability to ship production-ready optimizations in a fast-paced startup.
#J-18808-Ljbffr
Our group is growing, and we are hiring a Inference Performance Engineer: Fast LLMs, Equity & PTO in San Francisco, CA, United States.
We would love to welcome a new Inference Performance Engineer: Fast LLMs, Equity & PTO to our organisation in San Francisco, CA, United States.
For the Inference Performance Engineer: Fast LLMs, Equity & PTO position at Baseten, we are reviewing applications now.
Step into the Inference Performance Engineer: Fast LLMs, Equity & PTO role at Baseten in San Francisco, CA, United States and grow with us.