Jobs
Indexed directly from employers. Every age is their own publish date.
Indexed directly from employers. Every age is their own publish date.
Indexed directly from employers. Every age is their own publish date.
Searching titles and descriptions for “Software Engineering Manager, AI Observability & Evals Platform (San Francisco, CA)”. A match may be a passing mention rather than the job itself. Titles only.
66 roles across 68 listings · show every listing · page 1 of 3
…ABOUT THE ROLE We’re looking for an Engineering Manager to lead the team building LangSmith, our observability and evaluation platform for LLM applications…
…Collaborate with platform teams to integrate agentic workflows into the data engineering lifecycle. Evaluate and adopt emerging AI-native tooling for data engineering, staying…
…AI, developer experience, platform engineering, and healthcare. This is a hybrid role with a minimum of 3 days / week (MWF) in our San Francisco…
…caught before customers notice, and on-call pages are actionable instead of noisy. Build and maintain AI-powered automation that improves how we manage…
…Ship them with evals, observability of agent decisions, cost tracking, and human-in-the-loop checkpoints where autonomous action carries blast radius. Apply AI…
…securing complex software systems, and you are comfortable working in production code with product and platform engineers. - Security architecture judgment: You can look at…
…scale. - You're familiar with the modern AI stack—prompt engineering, eval frameworks, RAG pipelines, tool calling, and agent orchestration—and you have a…
…a Software Engineer, Infrastructure at Sierra, you will be responsible for designing, building, and maintaining the core systems that make our AI platform possible…
…observability, fault tolerance, and on-call operational practices - Experience supporting AI/ML research workflows, including building and optimizing training stack, experiment tracking, dataset management…
…The annual OTE range for this position for candidates located in California (excluding San Francisco Bay Area), Colorado, Illinois, New York, and Washington is…
…Trust & Safety, fraud, integrity, or abuse engineering at a consumer platform Building ML platforms, MLOps, or automated decisioning at scale Managing vendor-based ops…
…building stateful, multi-step AI workflows - Familiarity with LangSmith or equivalent AI observability/evaluation platforms for tracing, prompt management, and regression testing of LLM…
…The annual base salary range for this position for candidates located in California (excluding San Francisco Bay Area), Colorado, Illinois, New York, and Washington…
…The LaunchDarkly platform was built to guide engineers to the next frontier of DevOps by: Improving the velocity and stability of software releases, without…
…deployment, feature management, and observability. In this role, you will establish rigorous evaluation frameworks to measure model performance across diverse use cases and build…
…Define the foundational architecture for enterprise agentic AI at Benchling — orchestration, agent frameworks, tool integrations (including MCP), memory and state management, evaluation, and observability…
…platform capabilities like retrieval, evaluation, agents, and observability should come together, and how AI/ML teams should evolve as the field becomes more software…
…As a Senior Software Engineer, you will design, build, and operate software that helps teams launch and manage products across Microsoft. You will work…
…looking for an engineering manager to lead a team building software systems that detect and prevent harmful misuse of frontier AI models—before incidents…
…software engineers, ML engineers, platform teams, and product organizations to deploy AI into mission-critical workflows. Identify reusable engineering patterns that become core capabilities…
…software engineers, ML engineers, platform teams, and product organizations to deploy AI into mission-critical workflows. Identify reusable engineering patterns that become core capabilities…
…software engineers, ML engineers, platform teams, and product organizations to deploy AI into mission-critical workflows. Identify reusable engineering patterns that become core capabilities…
…the Databricks Data + AI Platform to build and scale data and AI apps, analytics and agents. Headquartered in San Francisco with 30+ offices around…
…the future of observability. At New Relic, we build an intelligent platform that empowers companies to thrive in an AI-first world by giving…
…You will work at the intersection of product engineering, AI, data, marketing, and financial infrastructure. The ideal candidate is a product-minded backend engineer…