Jobs
Indexed directly from employers. Every age is their own publish date.
Indexed directly from employers. Every age is their own publish date.
Searching titles and descriptions for “Senior Software Engineer, LLM Inference”. A match may be a passing mention rather than the job itself. Titles only.
12 roles
…Proven experience in a senior role, with 5+ years of full-time software engineering experience. Deep understanding of modern infrastructure practices, including CI/CD…
…Engage with partner software organizations, from engineering teams to technical leaders, and decision-makers to understand their goals, solve technical challenges, and promote best…
…Guest Experience is responsible for Search and Discovery, Merchandising, and end-to-end online software experience worldwide from top-of-funnel discovery through post…
…lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure. As a Senior Backend Engineer, you will play a…
NVIDIA is seeking a sharp, innovative, and hands-on Architect to help shape the future of LLM inference at scale. Join our dynamic E2E…
…virtualized infrastructure layer powering Together’s inference, RL, and fine-tuning products. As a Senior Software Engineer in Together Cloud Infrastructure, you will play…
…The software architecture group at NVIDIA has openings for a Deep Learning Communication Architect. We scale the DNN models and training/inference frameworks to…
…You will be focused on working with engineering to understand the technical capabilities of our inference stack from GPUs, CPUs, networking, CUDA libraries, model…
…Hands-on with LLM integration — streaming inference, prompt orchestration, retrieval-augmented generation. Experience building serverless or function-as-a-service platforms. Workflow engines (Temporal…
…areas: LLM and HPC. Having expertise ranging from operator-level through framework-level to algorithm-level optimization is strongly preferred. Proven software engineering fundamentals…
…of LLM and RAG capabilities. Work closely with NVIDIA engineering teams to provide feedback and contribute to the evolution of generative AI software. Engage…
…We’re hiring Staff and Senior Software Engineers to work on one of the teams that powers the entire company: Infrastructure, Platform, and Leverage…