Hewlett Packard Enterprise Development LP in the United States seeks a Senior Software Engineer to design and evolve the model runtime for the AI inference platform, focusing on low tail latency and high GPU utilization on customer-owned hardware. You will implement core components, work with inference teams, and enhance batching, KV cache management, and distributed execution across GPUs.
The role is hybrid with an expected 2 days per week from an HPE office, with remote options considered.
#J-18808-Ljbffr
This role, Senior LLM Inference Engineer — Hybrid & GPU-Focused at Hewlett Packard Enterprise, could be your next move.
If your experience matches this role, we encourage you to apply.
All applications are reviewed carefully by our team.
The position is based in Spring, TX, United States.
This opportunity is part of our work in IT & Technology.