Jobs
Indexed directly from employers. Every age is their own publish date.
Indexed directly from employers. Every age is their own publish date.
Searching titles and descriptions for “Software Engineer, Inference AI/ML”. A match may be a passing mention rather than the job itself. Titles only.
1,279 roles across 1,469 listings · show every listing · page 2 of 52
…Familiarity with AI/ML concepts, especially in areas such as Machine Learning, Inference, Performance Optimization, Capacity Management, and Inference Efficiency and Optimizations. Ability to…
About the Role We're looking for a Software Engineer to build the systems that treat infrastructure as software. This role owns the software…
…shipping software applications. - Demonstrated experience building AI or LLM-powered products, agents, or agentic workflows that real users depend on. - Strong software engineering fundamentals…
ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer…
…Inferentia and Trainium Systems — delivering high-performance ML inference and training at cloud scale. We’re looking for a Senior Manager, Physical Design Engineering…
…Language Model fundamentals, including architecture, training/inference lifecycles, and optimization of model execution - Experience using managed ML/AI solutions Amazon is an equal opportunity…
…AI, Accelerated Compute/GPU infrastructure, HPC, Security, Networking, or Storage - • Experience helping customers design and optimize infrastructure for AI/ML workloads (training clusters, inference…
Our Machine Learning Acceleration (MLA) team develops the Inferentia and Trainium SoCs that are used to power today’s AI workloads in datacenters all…
…Experience building or supporting production AI/ML platforms (training, deployment, and model serving/inference), including GPU infrastructure/tooling. Strong DevOps/platform engineering practices: CI…
…in Computer Science, AI/ML, Engineering, or a related field, or equivalent experience. 8+ years of software engineering experience, including ownership of production systems…
…You'll work closely with engineers across inference, compilers, kernels, and ML systems to identify performance bottlenecks and build the software needed to take…
…software stacks for novel AI accelerators. We work closely with ML researchers and developers to optimize and scale out model training and inference. The…
Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another…
…8+ years of engineering experience designing and deploying electrical products Deep expertise in GPU-accelerated computing architecture for AI/ML workloads (NVIDIA, AMD, or…
…As a Staff Software Engineer on the Protect Core team, you will set the technical direction for the systems that serve Trust Index scores…
…reproducible ML workflows. Experience with distributed training or HPC frameworks, inference serving, systems languages, high-performance networking, Unreal/client-server architecture, AI-assisted development…
…hands on experience with production ML systems, large-scale training infrastructure, NCCL, CUDA libraries and tools #AIINFRA Software Engineering IC3 - The typical base pay…
…Architect new systems, components, and capabilities to solve new and interesting problems in the AI inference space. Basic qualifications 12+ years of software engineering…
…7+ years of software engineering experience with a proven track record of designing, building, and operating production-scale machine learning systems and platforms (MLOps…
…generative AI inference running in Apple's cloud, with verifiable privacy guarantees no other large-scale AI platform offers. It is the server software…
…Leadership Manage individual contributors' daily tasks Mentor software and AI engineers to ensure high product quality across both deterministic code and AI/model behavior…
…Leadership Manage individual contributors' daily tasks Mentor software and AI engineers to ensure high product quality across both deterministic code and AI/model behavior…
…you're talking to a customer's engineers or their leadership - Genuine curiosity about AI inference and training, and a drive to become an…
…8+ years across data engineering, analytics engineering, software engineering, or ML engineering, with the last 3+ years building and shipping Applied AI and agentic…
…customers achieve their AI inference goals on Mantle and Amazon Bedrock Architect production-ready inference solutions leveraging Mantle's distributed engine, Zero Operator Access…