…optimization, targeting cost-efficiency improvements in compute, storage, and LLM inference spend - Mentor engineers on the team through code reviews, design feedback, and architecture…

…Experience with Inference deployment and optimization software (ex. vLLM, SGLang, FlashInfer, TensorRT-LLM, Triton, Dynamo, TorchAO, etc.) Demonstrable knowledge of GenAI or machine learning…

…NVIDIA is hiring a Senior AI Compiler Engineer. GPUs are driving rapid progress in deep learning—from LLMs and generative AI to recommendation, vision…

…As a Senior Software Engineer, you'll tackle the most challenging problems at the intersection of Kubernetes, distributed systems, and AI infrastructure. What you…

…Accelerate distributed inference using NVIDIA technologies such as NIM, TensorRT-LLM, vLLM, and SGLang. Collaborate with business, engineering, and product teams while providing technical…

…from model enablement and inference optimization, to the agentic frameworks and orchestration engines that coordinate work across compute tiers, to the open protocols and…

…from model enablement and inference optimization, to the agentic frameworks and orchestration engines that coordinate work across compute tiers, to the open protocols and…

…you'll own discrete pieces of real systems under the mentorship of senior engineers, not shadow work or isolated coursework-style projects. What You…

…Experience deploying, serving, and optimizing LLMs or ML models directly in the production, inference runtimes/compilers (ONNX Runtime, TensorRT/TensorRT-LLM), and serving frameworks…

…learning and software engineering Proven track record of shipping production-grade ML/LLM systems Strong understanding of LLMs, fine-tuning, prompt engineering, and RAG…

…About You 5+ years of software engineering experience (or 4+ with a Master's) in computer science, engineering, or equivalent practical experience. Staff-level…

…modeling, Bayesian inference, hierarchical learning, and robust evaluation. In this hybrid role, you will report to a Senior Staff Software Engineer. You will: Partner…

…from training next-gen LLMs on our own NVIDIA DGX SuperPODs to delivering real-time Language AI to over 300 million users and 200…

…Engineering Group, Engineering Group > Software Engineering General Summary: We are seeking an experienced and highly motivated Senior Lead Engineer to lead the design, deployment…

…Our infrastructure is the foundation that powers every customer interaction, every model inference, and every production workload. We’re looking for a Production Engineer…

…As a Staff/Senior Machine Learning Engineer, you play a critical role in developing world-class Search and Q&A experiences for Apple customers…

…of how AI agents, LLMs, and protocol-level tool connectivity work. You don’t need to be a hypervisor engineer, but you need to…

…data quality and engineering standards. - Embed AI tooling into your workflow in ways that have tangible business impact, including LLM-augmented pipelines and GenAI…

…As a Senior Performance Co-Design Engineer, you will focus and conduct LLM Serving Studies. In this role, you will work on analyzing and…

…workflow engine (Argo, Airflow, Prefect, Temporal). • Familiarity with GPU workloads, CUDA toolchains, or inference serving frameworks (vLLM, TensorRT-LLM, Triton). • Experience with LLM agent…

…inferences per day in major Microsoft products, including Office, Windows, Bing, SQL Server, and Dynamics. As a Senior and/or Principal Software Engineer - Performance…

…SENIOR SOFTWARE ENGINEER — CORTEX TRAINING The Snowflake ML Platform team's mission is to let customers run their most demanding ML/AI workloads inside…

…We’re looking for a Senior Production Engineer with a strong background in distributed systems and cloud services to help us build and deliver…

We are seeking senior engineers to pioneer new methodologies for accurately assessing the performance and capabilities of ground-breaking deep learning models, including LLMs…

…Deep familiarity with NVIDIA's AI software stack, including CUDA, TensorRT-LLM, NeMo, RAPIDS, Dynamo, Triton, or Isaac. Experience driving the implementation of AI…