We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme…

…Software Development Engineer on the Inference Model Enablement team, you will onboard and optimize state-of-the-art open-source and customer LLMs, both…

…We are hiring a Software Engineer to productionize and optimize our GPU serving stack, working across our custom inference APIs, the vLLM serving runtime…

…We are looking for high-agency engineers who are excited to work on powering model inference at enterprise scale. The impact you will have…

…machine learning systems and/or platforms. - Experience in serving LLMs using inference engines like vLLM, TensorRT-LLM, TEI, SGLang, and knowing tradeoffs between them…

We are now looking for a Senior Software Engineer for Quantized Inference! NVIDIA is seeking software engineers to accelerate the discovery and deployment of…

…software to serve inference of trained AI models running on GPUs. Contribute to the development of disaggregated serving for Dynamo-supported inference engines (vLLM…

…real-time and batch inference, powering model inference at enterprise scale. We are looking to hire high-agency engineers who bridge the gap between…

…We are seeking a Senior Software Engineer to design, build, and optimize highly scalable and reliable automation systems that ensure the peak performance and…

…strong interest in LLM serving; prior inference or ML experience is not required Have significant software engineering experience, with a strong background in high…

…committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role The Cloud Inference team scales and…

…inference trends to inform the team's technical direction Required Qualifications 12+ years of software engineering experience, including 2+ years leading and managing engineering…

…As a Software Engineer on the Inference Stack team, you’ll work across the stack - from the developer experience customers use to deploy models…

…This role is for a senior software engineer in the Machine Learning Inference Applications team. This role is responsible for development and performance optimization…

ABOUT THE TEAM We’re hiring a Developer Productivity engineer to support OpenAI’s Inference Runtime teams. These teams own the systems responsible for…

We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme…

…inference stack to power Voice AI models - from product roadmap through engineering implementation. You’ll partner closely with Forward Deployed Engineers, Model Performance Engineers…

…versatile Senior Software Engineer who is passionate about performance optimization and generative AI. Our team brings the latest research in LLM inference — from novel…

…ABOUT THE ROLE As a Software Engineer on the Model Routing & Inference team at Cursor, you'll build the inference platform that powers every…

…building on top of it! We're looking for a Senior Software Engineer to work at the frontier of large-scale LLM serving, partnering…

…As a Senior Software Engineer in the TensorRT team, you will be responsible for designing and implementing inference software optimizations to power AI applications…

…Strong programming skills and a "reliability-first" approach to software development. Nice to Have: A career history that spans both ML Software Engineering and…

…TensorRT team as a Senior Software Engineer, and be at the forefront of technology, enabling high-performance AI inference solutions for automotive safety and…

We are looking for a Senior System Software Engineer to work on Dynamo-Triton Inference Server . NVIDIA is hiring software engineers for its GPU…

We are now looking for a Senior Software Engineer for Deep Learning Inference! Would you like to make a big impact in Deep Learning…