ZealHire Inc. is seeking an AI Engineer specialized in evaluating LLM-powered agents. The role focuses on hands-on design, implementation, and execution of agent evaluation frameworks to assess response quality, reliability, and tool usage.
Candidate will develop golden datasets with Business Analysts, instrument agent executions using Langfuse, and drive end-to-end agent evaluation programs. This is a 3+ month contract in the Los Angeles area with potential extension.
#J-18808-Ljbffr
As a AI Engineer — Agent Evaluation & LLM Benchmarking, you will play an important part at ZealHire Inc. in Los Angeles, CA, United States.
Full responsibilities and requirements are described in the listing above.
Learn more about the AI Engineer — Agent Evaluation & LLM Benchmarking role in the description above.
We appreciate your interest in this position.
Join ZealHire Inc. and contribute to our ongoing work.