…As a Staff Software Engineer (IC5) on the Inference team, you will act as a technical leader driving architecture, performance, and reliability across multiple…

…As a Staff Software Engineer on our Inference team , you will work end to end, identifying and addressing key infrastructure blockers to serve Claude…

…AI accelerator platforms and support inference for new model architectures Minimum qualifications Proficiency in Python or Rust Software engineering experience building and operating distributed…

About the Role We're looking for a Software Engineer to build the systems that treat infrastructure as software. This role owns the software…

About the Role We're looking for a Software Engineer to build the systems that treat infrastructure as software. This role owns the software…

About the Role We're looking for a Software Engineer to build the systems that treat infrastructure as software. This role owns the software…

About the Role We're looking for a Software Engineer to build the systems that treat infrastructure as software. This role owns the software…

…Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft. We are a global technology company headquartered…

…About the Role We're hiring a Staff Engineer to own major areas of the architecture of our Inference Cloud Platform. This team owns…

…About the Role We're hiring a Staff Engineer to help lead, drive, and contribute to projects on our Inference Platform team. Our team…

…Integrate new AI accelerator platforms and support inference for new model architectures Minimum qualifications Significant software engineering experience, particularly with distributed systems Results-oriented…

…Maintain an in-house ML inference platform to serve large language models efficiently. Maintain an in-house ML compiler platform to compile, deploy, and…

…We are hiring a Software Engineer to productionize and optimize our GPU serving stack, working across our custom inference APIs, the vLLM serving runtime…

…We are looking for high-agency engineers who are excited to work on powering model inference at enterprise scale. The impact you will have…

…machine learning systems and/or platforms. - Experience in serving LLMs using inference engines like vLLM, TensorRT-LLM, TEI, SGLang, and knowing tradeoffs between them…

…real-time and batch inference, powering model inference at enterprise scale. We are looking to hire high-agency engineers who bridge the gap between…

…Integrate new AI accelerator platforms and support inference for new model architectures Minimum qualifications Significant software engineering experience, particularly with distributed systems Results-oriented…

…We're looking for a Staff Engineer to be a technical lead for Inference Runtime: the team that owns the shared, accelerator-agnostic core…

…Integrate new AI accelerator platforms and support inference for new model architectures Minimum qualifications Significant software engineering experience, particularly with distributed systems Results-oriented…

…strong interest in LLM serving; prior inference or ML experience is not required Have significant software engineering experience, with a strong background in high…

…committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role The Cloud Inference team scales and…

P-1285 About This Role As a staff software engineer for GenAI inference, you will lead the architecture, development, and optimization of the inference…

…inference scaling across multi-node clusters using Ray Serve and Triton Experience in leading technical projects and supporting architectural decisions with data Software Engineering…

…experience reasoning about model routing, inference cost, and latency tradeoffs in production Strong software engineering fundamentals: distributed systems, API design, and testing discipline Comfort…