Nebius is seeking a Senior Machine Learning Engineer on the Applied AI team to own model and endpoint optimization from artifacts to production. You will optimize latency, throughput, memory, and cost per token while preserving quality; collaborate with kernel and platform engineers on serving problems and benchmarking.
You will evaluate optimizations across engines like vLLM, TensorRT-LLM, Triton, and NVIDIA Dynamo, implement quantization workflows, and design scalable multi-node inference with
#J-18808-Ljbffr
We have an opening for a Senior ML Engineer - AI Inference & Optimization in Palo Alto, CA, United States within IT & Technology.
Step into the Senior ML Engineer - AI Inference & Optimization role at Nebius Group in Palo Alto, CA, United States and grow with us.
Please review the full job details above before applying.
If your experience matches this role, we encourage you to apply.