Hippocratic AI is seeking an experienced LLM Inference Engineer to optimize its LLM serving infrastructure in Palo Alto, CA. You will design multi-node architectures, implement multi-LoRA serving, and apply quantization techniques to reduce footprint while maintaining quality.
The role emphasizes practical production deployment, benchmarking, and latency-focused optimizations across GPUs, with a strong emphasis on Python, C++, and CUDA.
#J-18808-Ljbffr
This is a genuine role to take on the LLM Inference Engineer: Scale & Optimize Production role at Comunidade Metodista.
This role, LLM Inference Engineer: Scale & Optimize Production at Comunidade Metodista, could be your next move.
Are you ready to take on the LLM Inference Engineer: Scale & Optimize Production role at Comunidade Metodista?
We would love to welcome a new LLM Inference Engineer: Scale & Optimize Production to our team in Palo Alto, CA, United States.