We are now seeking a Senior Infrastructure Software Engineer for NVIDIA TensorRT Edge-LLM! NVIDIA's TensorRT Infrastructure group is seeking excellent software engineers…

…collaborating effectively across scientists and engineers - Experience with production LLM/multimodal serving internals (e.g., vLLM, TensorRT-LLM): scheduler, batching, block manager, sampler customization…

…vs software-only solutions), accelerate technology adoption and large-scale replication. Monitor cutting-edge industry trends including Agentic AI infrastructure patterns, LLM serving network…

…on software engineering concepts and 7+ years applied experience Deep, hands-on experience with LLM inference systems — vLLM, TensorRT-LLM, SGLang, LLM-D or…

…AI, cloud infrastructure, data platforms, modern application architecture, and AI deployment lifecycles. Ability to engage senior executives and hands-on engineering or architecture teams…

…Working knowledge of NVIDIA AI technologies, including NIM, Triton, TensorRT, TensorRT-LLM, CUDA, Nsight, RAPIDS, NGC, NVIDIA AI Enterprise, and GPU Operator. Ability to…

…infrastructure skills to cutting-edge AI/LLM engineering. The Modern AI Stack: Direct exposure to (or a strong conceptual understanding of) optimizing LLMs in…

…Job Description The Role We are looking for a Machine Learning Engineer to help build cutting edge ML infrastructure for building and serving LLM…

…The LocalAI team is seeking a Senior Systems Software Engineer to build efficient on-device AI software for RTX and DGX-class systems. This…

…Hands-on exposure to core NVIDIA AI software and SDKs relevant to model builders, including NeMo Framework, NeMo Curator, Nemotron model families, TensorRT-LLM…

…The LocalAI team is seeking a Senior Systems Software Engineer to develop efficient on-device AI software for RTX and DGX-class systems. The…

…Deepgram is seeking a Senior Technical Program Manager (AI Tooling & Systems) for Engineering to drive execution of large-scale ML infrastructure and AI tooling…

…12+ years of software engineering experience in systems software, AI/ML infrastructure, deep learning inference, compiler/runtime technology, or platform performance. Strong C/C…

NVIDIA is hiring exceptional software engineers to build and optimize the core inference infrastructure for large language models. Join the TensorRT‑LLM team - the…

…s TensorRT Edge-LLM team and help shape the next generation of edge AI for automotive and robotics. We build the software stack that…

…Architect and implement deep integrations with leading LLM serving engines (such as vLLM, SGLang, TensorRT-LLM), with a focus on KV-cache offload, reuse…

…engineers, to ensure data pipelines meet the demands of cutting-edge language models. You may be a good fit if you have: - Strong software…