…About the Role We're hiring a Software Engineer to help contribute to projects on our Inference Platform team. Our team primarily owns the…

About the Team Our team analyzes inference stack performance across the application, model, and fleet layers to identify bottlenecks and drive faster, cheaper inference…

…Curiosity about GPU inference concepts (micro-batching, KV cache, streaming). Preferred: Internship or project that deployed a microservice or ML inference demo. Coursework/research…

…About the Role We're hiring a Staff Engineer to help lead, drive, and contribute to projects on our Inference Platform team. Our team…

…qualifications 8+ years of software engineering experience, with significant time as the technical lead or anchor on a platform, inference runtime, or ML infrastructure…

…Integrate new AI accelerator platforms and support inference for new model architectures Minimum qualifications Significant software engineering experience, particularly with distributed systems Results-oriented…

…As a Staff Software Engineer (IC5) on the Inference team, you will act as a technical leader driving architecture, performance, and reliability across multiple…

…As a Staff Software Engineer on our Inference team , you will work end to end, identifying and addressing key infrastructure blockers to serve Claude…

…Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft. We are a global technology company headquartered…

…Senior engineers are area owners who lead designs, raise engineering standards, and deliver measurable improvements to latency, throughput, and reliability across multiple services. You…

NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. As a key contributor, you will help design, build…

…strong interest in LLM serving; prior inference or ML experience is not required Have significant software engineering experience, with a strong background in high…

…committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role The Cloud Inference team scales and…

…inference trends to inform the team's technical direction Required Qualifications 12+ years of software engineering experience, including 2+ years leading and managing engineering…

…As a Software Engineer on the Inference Stack team, you’ll work across the stack - from the developer experience customers use to deploy models…

…This role is for a senior software engineer in the Machine Learning Inference Applications team. This role is responsible for development and performance optimization…

ABOUT THE TEAM We’re hiring a Developer Productivity engineer to support OpenAI’s Inference Runtime teams. These teams own the systems responsible for…

We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme…

…inference stack to power Voice AI models - from product roadmap through engineering implementation. You’ll partner closely with Forward Deployed Engineers, Model Performance Engineers…

…versatile Senior Software Engineer who is passionate about performance optimization and generative AI. Our team brings the latest research in LLM inference — from novel…

…ABOUT THE ROLE As a Software Engineer on the Model Routing & Inference team at Cursor, you'll build the inference platform that powers every…

…building on top of it! We're looking for a Senior Software Engineer to work at the frontier of large-scale LLM serving, partnering…

…As a Senior Software Engineer in the TensorRT team, you will be responsible for designing and implementing inference software optimizations to power AI applications…

…Strong programming skills and a "reliability-first" approach to software development. Nice to Have: A career history that spans both ML Software Engineering and…

…TensorRT team as a Senior Software Engineer, and be at the forefront of technology, enabling high-performance AI inference solutions for automotive safety and…