Jobs
Indexed directly from employers. Every age is their own publish date.
Indexed directly from employers. Every age is their own publish date.
Indexed directly from employers. Every age is their own publish date.
Searching titles and descriptions for “Software Engineer, GPU Inference”. A match may be a passing mention rather than the job itself. Titles only.
975 roles across 1,096 listings · show every listing · page 1 of 39
…We are hiring a Software Engineer to productionize and optimize our GPU serving stack, working across our custom inference APIs, the vLLM serving runtime…
…We are hiring a Software Engineer to productionize and optimize our GPU serving stack, working across our custom inference APIs, the vLLM serving runtime…
…inference scaling across multi-node clusters using Ray Serve and Triton Experience in leading technical projects and supporting architectural decisions with data Software Engineering…
…classification for execution on GPUs under tight latency and throughput constraints. We are looking for a Principal Software Engineer who is excited to work…
…The team develops and owns the software stack around NCCL (NVIDIA Collective Communications Library), which enables multi-GPU and multi-node data communication through…
…This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services. This…
…Solve technically tests problems that exceed the scope of a generalist Software Engineers, specifically around optimizing Generative AI performance across heterogeneous hardware (CPUs, GPUs…
…As a Quantum Systems Digital Design Engineer II , you’ll collaborate closely with quantum physicists, systems software, RF/EE, and manufacturing/production to define…
…About the team The team is comprise of both Hardware Design Engineers, System Design Engineers, Software Development Engineers and Technical Program Managers, all with…
…with Principal Engineers, SDMs, and Principal Scientists, identifying dependencies, scaling factors, boundary conditions, and risks across horizontal distributed systems serving AI inference at global…
…As Lead Machine Learning Engineer on the Digital Intelligence team, you will be collaborating with a high-caliber team of software developers and deep…
…design and implement the software that models the full lifecycle of a physical host from discovery, inference bring-up to GPU driver/CUDA stack…
…This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services. This…
…Inferentia and Trainium Systems — delivering high-performance ML inference and training at cloud scale. We’re looking for a Senior Manager, Physical Design Engineering…
…software development, cloud computing, systems engineering, infrastructure, security, networking, data & analytics). - Experience in external enterprise customer-facing role as a technical lead, with strong…
By submitting your resume, you’re expressing interest in one of our 2027 Software Engineering New College Grad roles. We’ll review resumes on…
…Experience building or supporting production AI/ML platforms (training, deployment, and model serving/inference), including GPU infrastructure/tooling. Strong DevOps/platform engineering practices: CI…
…Experience with GPU inference optimization, model serving, workflow engines, or multi-tenant cloud services. Experience integrating AI systems with enterprise APIs, databases, identity systems…
…About the Role As a Software Engineer, Trainium, you will help bring OpenAI's inference workloads to AWS Trainium and build the software stack…
…As a Software Engineer II or Senior Software Engineer - Simulation Platform, you will be responsible for designing, implementing, and ensuring quality of AI chip…
Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another…
…GPU-accelerated compute clusters optimized for AI inference and training workloads at the tactical edge (NVIDIA H100/A100, AMD MI300, or similar) Engineer advanced…
…3+ years of software engineering experience, with meaningful experience in infrastructure, platform engineering, or SRE roles. Experience operating distributed systems in production and keeping…
…As a Software Engineer on the AI infrastructure team, you will work on cutting edge infrastructure and tools to support large scale model deployments…
…Architect new systems, components, and capabilities to solve new and interesting problems in the AI inference space. Basic qualifications 12+ years of software engineering…