Jobs
Indexed directly from employers. Every age is their own publish date.
Searching titles and descriptions for “Senior Software Engineer, LLM Inference”. A match may be a passing mention rather than the job itself. Titles only.
99 roles across 114 listings · show every listing · page 1 of 4
31dSenior Engineering Manager, D&I Analytics…on-call rotations Establish sound engineering practices to build software and design training & inference pipelines Collaborate across our engineering organization and other cross functional…
31dStaff Machine Learning Engineer - Vision-Language Foundation Models…Mentor senior engineers, lead rigorous design reviews, and establish standard-setting engineering practices from advanced prototyping to production deployment. You Have: Master’s degree…
31dSDE, Responsible AI…We are looking for a Software Development Engineer who wants to work at the frontier of AI governance — building the platform that gives Amazon…
- 31dSenior System Software Engineer - Local AI
…The LocalAI team is seeking a Senior Systems Software Engineer to build efficient on-device AI software for RTX and DGX-class systems. This…
- 31dSenior Engineer, Local AI - Agents and Systems
…We seek a Senior Engineer to lead technical efforts in deploying advanced AI agent frameworks and local runtimes on Windows and NVIDIA GeForce RTX…
- 31dSenior Engineer - AI Agents and Systems
…We seek a Senior Engineer to lead technical efforts in deploying advanced AI agent frameworks and local runtimes on Windows and NVIDIA GeForce RTX…
- 31dPrincipal Engineer, Local AI - Agents and Systems
…We seek a Senior Engineer to lead technical efforts in deploying advanced AI agent frameworks and local runtimes on Windows and NVIDIA GeForce RTX…
- 31dSenior Developer Relations Manager
…and production inference. The ideal candidate is a senior technical DevRel leader who can earn credibility with ML researchers and platform engineers. This person…
31dEngineer/Senior Engineer- ML Libraries/ARM…CPU Software & Hardware Co-Design Engineer (ML Systems) Location: Bangalore (or relevant) Levels: Engineer / Senior Engineer / Staff / Principal Engineer Role Overview We are building…
31dSenior Systems Engineer, AI Gateway…tools, and automation can improve engineering productivity. Bonus Points Experience building AI/ML infrastructure, inference platforms, model gateways, LLM-powered applications, or provider abstraction…
31dSenior/Staff Software Engineer - Machine Learning Platform (Inference)…in serving LLMs using inference engines like vLLM, TensorRT-LLM, TEI, SGLang, and knowing tradeoffs between them. - Experience serving fine-tuned LLMs (PEFT, DPO…
32dEngineering Manager, Model Infrastructure…WHAT YOU HAVE - 8+ years of software engineering experience, including multiple years managing high-performing engineering teams. - Experience leading teams responsible for large-scale…
- 32dSoftware Development Manager , Alexa Sensitive Content Intelligence (ASCI)
…video, and LLM-generated responses. As a Software Development Manager, you will lead an engineering team building production-grade ML inference infrastructure and content…
- 32dSoftware Development Manager, LLM Inference Model Enablement, Neuron SDK
…As an SDM for the LLM Inference Model Enablement team, you will lead a team of expert AI/ML engineers to onboard and optimize…
- 32dSenior Applied Science Manager, AWS Analytics Engineering (AAE)
…inference, optimization, and LLM-based forecasting models) to build scalable ML products that help AWS grow and delight our customers? The AWS Analytics Engineering…
- 32dSenior System Software Engineer - LocalAI
…The LocalAI team is seeking a Senior Systems Software Engineer to develop efficient on-device AI software for RTX and DGX-class systems. The…
- 32dSenior Developer Technology Engineer - Edge Agentic AI
…Improve LLM & GenAI user experience by working on feature and performance enhancements of OSS software, including but not limited to projects like GGML, Llama…
- 32dNCX Senior Engineer
NVIDIA is seeking an NCX Senior Engineer to join our DSX team, collaborating closely with strategic customers to implement and enhance groundbreaking AI workloads…
32dSenior Staff Applied AI Inference Engineer…technologies. - A strong command of software engineering fundamentals, with a record of building and shipping AI/ML inference systems. - Experience with Docker and Kubernetes…
32dTechnical Program Manager, AI Delivery for Public Sector & Defence, UK…Required Experience: - 6+ years of experience as a customer-facing Technical or Engineering Program Manager in AI/ML consulting, technology transformation, or enterprise software…
33dSenior Machine Learning Engineer, AI Platform…QUALIFICATIONS: - - 3+ years of experience in applied machine learning, AI engineering, or ML-focused software engineering roles, including significant work in production environments. - Hands…
- 33dSDE II, Sales Data Services (SDS)
…pipelines that surface relevant advertiser context to LLM-based agents at inference time. - Partner with Software developers, PMTs and Business Intelligence Eng to integrate…
- 33dSenior Software Engineer, Quantized Inference
…Senior Software Engineer for Quantized Inference! NVIDIA is seeking software engineers to accelerate the discovery and deployment of efficient inference recipes for LLMs. A…
- 33dSenior Software Engineer - GPU Local AI Platforms
…12+ years of software engineering with depth in GPU computing, ML systems, or high-performance inference Strong Python or C++ programming, software design, and…
- 33dEngineer
…Engineering Group, Engineering Group > Software Applications Engineering General Summary: Job Description More details below: Join the exciting Generative AI team at Qualcomm focused on…