…agentic software development across engineering, expanding adoption, elevating our technical capabilities, and acting as a force for innovation Evaluate emerging AI tools, models, and…

…turning a fuzzy notion of quality into something measurable, with agent or model improvements to show for it. - Strong software engineering fundamentals, and the…

…Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts and 5+ years applied experience Hands-on practical experience delivering system…

…and engineering processes across multiple teams and technology domains Develop secure and high-quality production code, review and debug code written by others, and…

…software, SaaS, Data integration, and agent-enabled architecture that lets the company move quickly while improving security, compliance, data quality, and customer, partner, and…

…with model or agent evaluation: designing evals, measuring regressions, or turning fuzzy quality questions into measurable signals - A systems-and-outcomes mindset. You care…

…and contributing to agentic LLM workflows (retrieval pipelines, structured tool use, chained LLM calls) - Fix user-facing bugs and issues, and make quality-of…

…We are building Microsoft’s platform for physical intelligence—an integrated robotics software and AI platform that brings together humans, robots, and agents through…

…Datadog, CloudWatch - You've built and operated production systems where data quality and reliability both matter. - You're comfortable in SQL and Python, and…

…Build benchmarks, evaluation harnesses, and instrumentation that let us measure agentic and model decision quality objectively, and use them to drive real improvements. Develop…

…Engineering, Product, and Design teams are thoughtfully integrating AI across the full software and product development lifecycle to move faster without sacrificing quality or…

…engineering teams and the global community of data scientists and AI engineers. You'll focus on how practitioners build, evaluate, govern, and ship agentic…

…software engineering best practices, and technical standards. Strong business acumen and strategic thinking, with a proven ability to understand the broader business context, evaluate…

…inefficiencies and lead high-impact initiatives to improve planning quality, process consistency, speed of execution, and cross-functional alignment. - Evaluate, implement, and optimize tooling…

…This person will partner closely with Product, Engineering, Design, and Growth to raise the bar on decision quality and establish a more AI-native…

…We are also building the experimentation, tracking, and measurement capabilities needed to evaluate recommendation quality and business impact over time. How you will make…

…You will get to experiment with and integrate agentic AI into production engineering workflows, moving beyond simple prompt engineering to build resilient, AI-assisted…

…systems, and agentic evaluation pipelines. Innovation & Technical Depth Research, design, and operationalize new evaluation techniques and metrics that improve the quality and reliability of…

…SF and NYC WHAT YOU’LL DO: - Build and maintain benchmarks and evaluations that measure the quality and efficiency of Engine agents on real…

…chunking strategies, embedding model selection, retrieval optimisation, and quality evaluation. - Own the full AI-product lifecycle: prompt design, context and state management, agentic loops…

…Engineering, Product, and Design teams are thoughtfully integrating AI across the full software and product development lifecycle to move faster without sacrificing quality or…

…We are a globally distributed, remote-first team building the tools that define how software gets built and delivered. As AI agents redefine software…

…evaluate AI products. Pioneer AI Research Operations: Integrate AI tools, prompt engineering, and agentic research workflows into your daily practice to accelerate quality research…

…Software is being changed faster than ever, but CI remains a bottleneck and a major trust boundary. Developers and software agents need to run…

…Promote reusable components to improve efficiency and implement automated testing and deployment to maintain code quality. Evaluate new technologies for potential integration and document…