Jobs
Indexed directly from employers. Every age is their own publish date.
Indexed directly from employers. Every age is their own publish date.
Indexed directly from employers. Every age is their own publish date.
Searching titles and descriptions for “Software Engineer, Agent Evaluation and Quality”. A match may be a passing mention rather than the job itself. Titles only.
413 roles across 471 listings · show every listing · page 1 of 17
…We are a globally distributed, remote-first team building the tools that define how software gets built and delivered. As AI agents redefine software…
…Implement evaluation, monitoring, and telemetry capabilities to measure AI system quality, reliability, performance, and safety. Partner with engineering, applied science, product, security operations, and…
…agentic workflows, retrieval-augmented generation, knowledge graphs, feedback-driven optimization, multi-modal security signals, and rigorous evaluation frameworks to support security engineering and security…
At Linear, we're building the product development system for teams and agents. AI is fundamentally changing how software gets built, and we’re…
…This is a rare opportunity to work at the intersection of software engineering and rigorous evaluation science — applying machine learning engineering techniques, from model…
Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another…
…As an Agent PM at Sierra, you will be responsible for partnering directly with our engineers and customers to build and ship AI agents…
…Defining and building the agentic framework system that standardizes how agents are composed, orchestrated, and extended. Evaluation & Quality: Creating evaluation frameworks that measure, benchmark…
…from agent execution and LLM orchestration to state management, integrations, evaluation, observability, and production reliability. We are looking for a Senior Software Engineer to…
…prompt engineering, and AI model capabilities/limitations Experience with CI/CD, DevOps practices, and modern software development workflows Track record of evaluating and implementing…
As a Software Engineer on the AI Infrastructure team, you'll help build and evolve our agent sandboxing platform — the secure, high-performance code…
…and parts our engineering team co-designs with suppliers, ensuring Yubico’s proprietary innovations are contractually protected. Quality Safeguards: Oversee the Supplier Quality domain…
…assessment, bias mitigation, quality and accuracy reviews) Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging…
…Responsibilities As a Principal Software Engineering Manager on the Evaluation Platform Team, you will be responsible for managing a team and owning some of…
…Engineering Excellence Champion high-quality engineering practices across all delivery engagements. Ensure adherence to coding standards, architectural integrity, and performance benchmarks. Define and institutionalize…
…Lead multiple software engineering teams responsible for manufacturing platforms, enterprise integrations, agentic workflows, AI applications and factory-edge systems Establish a unified technical vision…
…matching frontier performance through training and harness engineering. (blog https://fireworks.ai/blog/open-source-agents-frontier-advisors) - The fine-tuning bottleneck is not…
…APIs and MCPs, along with experience with prompt engineering, LLM evaluation, and managing non-deterministic system behavior - 5+ years of full software development life…
…complex buyer and partner journeys across several different personas and interaction surfaces (web, console, agent, etc.) - Design and conduct generative and evaluative research using…
…network behavior, software stack, or deployment environment. Capture developer feedback, technical blockers, competitive insights, and product requirements for NVIDIA product and engineering teams. What…
…Lead AI initiatives spanning research, software, hardware, infrastructure, product, quality, security, legal, operations, marketing, and developer relations. Build roadmaps, achievements, ownership models, governance plans…
…RL runs, evaluation, and agentic AI infrastructure. We build the software foundations that help research and engineering teams train, evaluate, and deliver sophisticated AI…
…Engineers define intent, author precise specifications, and orchestrate AI agents that execute at speed and scale. AI is embedded throughout our development process, helping…
…Engineers define intent, author precise specifications, and orchestrate AI agents that execute at speed and scale. AI is embedded throughout our development process, helping…
…Strengthen change and release management practices by establishing readiness checks, progressive delivery standards, rollback procedures, runbook quality, and production hygiene expectations. Partner with Engineering…