IntelliPro Group is seeking a Machine Learning Engineer focused on Inference & Serving (Speech LLM) in San Francisco, CA, hybrid. You will build ultra-low-latency inference systems for large language and speech models, balancing latency and throughput across a GPU cluster.
You will collaborate with core ML training and backend infra teams to push performance, efficiency, and scalability, including real-time audio streaming and advanced decoding techniques. A strong systems mindset is essential.
#J-18808-Ljbffr
The ML Engineer: Ultra-Low-Latency Inference & Speech Serving position in the IT & Technology, Engineering field is open for applications.
We have an opening for a ML Engineer: Ultra-Low-Latency Inference & Speech Serving in San Francisco, CA, United States within IT & Technology, Engineering.
This role, ML Engineer: Ultra-Low-Latency Inference & Speech Serving at IntelliPro Group, could be your next career step.