ByteDance’s Infrastructure System Lab in Seattle is seeking a Research Engineer/Scientist to design a high-performance KV caching layer for LLM inference across GPUs and nodes. The role targets low latency, high throughput, and cost efficiency by reusing attention keys/values and embeddings in transformer models.
You will collaborate with inference and serving teams to integrate the cache with token streaming pipelines, memory-aware sharding, and multi-tenant consistency, with opportunities to
#J-18808-Ljbffr
Step into the LLM Inference KV Cache Engineer (Distributed) role at Bytedance in Seattle, WA, United States and grow with us.
We are seeking a motivated LLM Inference KV Cache Engineer (Distributed) to join Bytedance in Seattle, WA, United States.
Consider building your career as a LLM Inference KV Cache Engineer (Distributed) at Bytedance.
The LLM Inference KV Cache Engineer (Distributed) position in the IT & Technology, Other field is open for applications.