OpenRelay, Inc. in San Francisco/Seattle is seeking a high-autonomy engineer to own production LLM serving, from problem discovery to production, collaborating directly with the founders to shape technical direction.
You will optimize performance, cost, and reliability of models, bring new open-weight models to production, and tune GPU serving with batching, caching, and quantization. You will design routing across replicas andpaces, and push measurable wins in throughput and latency.
#J-18808-Ljbffr
We are seeking a motivated Staff Engineer, LLM Inference & Production to join OpenRelay, Inc. in San Francisco, CA, United States.
Consider building your career as a Staff Engineer, LLM Inference & Production at OpenRelay, Inc.
The Staff Engineer, LLM Inference & Production position in the IT & Technology field is open for applications.
We have an opening for a Staff Engineer, LLM Inference & Production in San Francisco, CA, United States within IT & Technology.