Jobs
Indexed directly from employers. Every age is their own publish date.
Indexed directly from employers. Every age is their own publish date.
Indexed directly from employers. Every age is their own publish date.
Searching titles and descriptions for “Software Engineer, Agent Evaluation and Quality”. A match may be a passing mention rather than the job itself. Titles only.
56 roles across 60 listings · show every listing · page 1 of 3
…Lead through uncertainty with determination and adaptability. What We’re Looking For 10+ years of software engineering experience, including 5+ years in a technical…
…As an Agent PM at Sierra, you will be responsible for partnering directly with our engineers and customers to build and ship AI agents…
…As an Agent PM at Sierra, you will be responsible for partnering directly with our engineers and customers to build and ship AI agents…
…As an Agent PM at Sierra, you will be responsible for partnering directly with our engineers and customers to build and ship AI agents…
…WHAT YOU’LL DO - Design and deliver production-grade AI agents https://sierra.ai/blog/meet-the-ai-agent-engineer: You'll build and…
…WHAT YOU’LL DO - Design and deliver production-grade AI agents https://sierra.ai/blog/meet-the-ai-agent-engineer: You'll build and…
…WHAT YOU’LL DO - Design and deliver production-grade AI agents https://sierra.ai/blog/meet-the-ai-agent-engineer: You'll build and…
…Agentic workflows for enterprise customers. Enhance engineering and infrastructure efficiency, reliability, accuracy, and response times, including CI/CD processes, test frameworks, data quality assurance…
…Quality procedures Perform quality engineering audits of design documentation for compliance with stated requirements, including vendor quality manuals and company quality records Evaluate effectiveness…
…from problem definition and feature engineering to training, evaluation, deployment, and monitoring Build scalable data and model pipelines with strong reliability, observability, and automated…
…Experience with software deployed and operated in customer environments (on-prem, appliance, agent, or self-hosted), including install, upgrade, and remote diagnosis. Familiarity with…
…5+ years of experience developing and evaluating ML applications, demonstrating a passion for understanding and improving model/data quality.‘ Deep understanding of multi-modal…
…software craftsmanship. We’re looking for experienced engineers who have shipped applied AI systems to production and want to define what the agent-native…
…BS/MS in STEM with 7+ years of experience developing and evaluating ML applications, demonstrating a passion for understanding and improving model/data quality…
…You’ll collaborate directly with product, design, engineering, and data to solve key agent challenges: evaluation harnesses, context compression, maintaining context across large codebases…
…assessment, bias mitigation, quality and accuracy reviews) Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging…
…Drive best practices for engineering excellence, including design reviews, code quality, testing strategies, and performance optimizations. Deliver high-quality, production-ready code and services…
…the quality and reliability of AI security tooling --- What We Look For 7–10 years of experience in security software engineering, security engineering, or…
…educational videos, onboarding paths, and sample repositories for SDK adoption. - Develop and deploy AI Agents as an Agent Software Engineer, building the knowledge to…
…assessment, bias mitigation, quality and accuracy reviews) Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging…
…Software Engineering and Systems Thinking. You’re comfortable reading and writing code, understanding how production systems fit together, and building pragmatic software solutions to…
…with forward-deployed Software and Machine learning Engineers to develop agents in the initial post-sales stage Work with AEs and PMs to identify…
…WHAT YOU’LL DO - Design and deliver production-grade AI agents https://sierra.ai/blog/meet-the-ai-agent-engineer: You'll build and…
…Quality, including ranking models and evaluation frameworks. Manage and operate large-scale, highly-available services in the cloud. Grow and mentor engineers and emerging…
…Engineer to lead enhancements to our Search Quality. In 2025, we will focus on enhancing search ranking, improving query understanding, building robust evals and…