Jobs
Indexed directly from employers. Every age is their own publish date.
Indexed directly from employers. Every age is their own publish date.
Indexed directly from employers. Every age is their own publish date.
Searching titles and descriptions for “Staff Software Engineer, GPU Inference”. A match may be a passing mention rather than the job itself. Titles only.
38 roles across 39 listings · show every listing · page 1 of 2
…We are hiring a Software Engineer to productionize and optimize our GPU serving stack, working across our custom inference APIs, the vLLM serving runtime…
…As a Software Engineer II on the team, you will help design, build, and harden a secure, evaluable, vendor-agnostic agent platform that teams…
…1) AI Infrastructure with purpose-built chips like AWS Trainium and Inferentia, GPU-powered instances, and optimized frameworks like PyTorch and JAX, 2) AI…
…are optimized for Training and Inferencing. Lead the development of end-to-end AI network architecture including gpu-gpu, server – storage, in-rack cabling…
…Experience with inference-serving frameworks, GPU-aware scheduling, or model-performance optimization. Expertise in vector databases, GPU-accelerated query engines, or distributed data platforms…
…Engineering Analyze software requirements and collaborate with architecture and hardware engineers to support AI workloads. Build, deploy, and operate components supporting LLM inference, agentic…
…Proven ability to design, implement, and optimize scalable ML architectures, from distributed training to real-time inference. Strong software engineering skills in Python, C…
…LLM inference, an inter-agent message bus, parametric CAD pipelines, a print farm, and the infrastructure connecting it all. We need an engineer who…
…key workloads with ultra high-speed inference. Key Responsibilities - Work with architects, designers, post silicon and software engineers to ensure a high-quality design…
…Experience with large-scale distributed systems for AI/ML workloads running on GPUs or TPUs. Strong software engineering skills with experience developing and optimizing…
…Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About…
…Industry-leading acceleration technologies such as TPUDirect, TPUDirect Storage (TDS), and GPUDirect Storage (GDS). As a Senior Staff Software Engineer, you will lead the…
…Partner with engineering to optimize local AI inferencing and application development across CPU, GPU, NPU, and heterogeneous compute resources. Define enterprise-grade requirements for…
…engineering discipline, and the ownership mindset to build more resilient systems YOU’D GET BONUS POINTS FOR - GPU infrastructure for training or inference at…
…key workloads with ultra high-speed inference. Key Responsibilities - Work with architects, designers, post silicon and software engineers to ensure a high-quality design…
…This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services. This…
…1) AI Infrastructure with purpose-built chips like AWS Trainium and Inferentia, GPU-powered instances, and optimized frameworks like PyTorch and JAX, 2) AI…
…1) AI Infrastructure with purpose-built chips like AWS Trainium and Inferentia, GPU-powered instances, and optimized frameworks like PyTorch and JAX, 2) AI…
…powers the next generation of AI training and inference at scale. As a Staff Engineer on our Orchestration team, you will collaborate to help…
…Work alongside Staff and Senior engineers to resolve complex race conditions in the I/O path and optimize kernel-level memory pinning for GPU…
…Software Engineering IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There…
…OR Master's degree in Computer Science, Engineering, Information Systems, or related field and 3+ years of Hardware Engineering, Software Engineering, Systems Engineering, or…
…Engineering Group, Engineering Group > Machine Learning Engineering General Summary: The Sr Staff Engineer Engineer, Verification (CI/CD & Embedded HW) is a senior individual contributor…
…a Staff ML Performance Engineer, you’ll play a key role in high-impact projects, optimising ML inference for edge accelerators and GPUs. The…
The MLIL DataPlane team is looking for a Software Development Engineer to own the design and implementation of our inference data plane. We build…