Jobs
Indexed directly from employers. Every age is their own publish date.
Indexed directly from employers. Every age is their own publish date.
Indexed directly from employers. Every age is their own publish date.
Searching titles and descriptions for “Manager, Large Language Model Inference”. A match may be a passing mention rather than the job itself. Titles only.
564 roles across 663 listings · show every listing · page 6 of 23
…LLMs, vision-language, TTS, ASR, and diffusion AI workloads. Perform end-to-end optimization of AI models, data pipelines, and inference runtimes to enhance…
…Experience with Kubernetes, distributed training, and large-scale inference. Experience supporting or using PCIe accelerators such as GPUs, FPGAs, DSPs from evaluation to production…
…AI/ML platforms, Large Language Models (LLMs), inference services, and AI infrastructure. Required Skills Cloud & Infrastructure Oracle Cloud Infrastructure (OCI) Cloud Architecture Infrastructure as…
…workloads in Azure – extreme scale AI training and inference including large language models, traditional HPC modelling and simulations, remote visualization, and immersive gaming experiences…
…management. - Build secure platforms for data ingestion, processing, and curation: classification, encryption, access controls, and safe sharing patterns across teams. - Write threat models and…
…to focus on advancing model capabilities rather than managing bottlenecks. Our focus is on performant and efficient model inference both to power real-world…
…Linux, networking, and infrastructure‑as‑code. - Familiarity with CUDA/NCCL and performance profiling for distributed training/inference. - Prior work supporting large‑scale model training…
…Key job responsibilities - Develop and optimize compute kernels for a custom ML accelerator architecture, targeting production-level performance for large language model inference. - Implement…
…learning models on large-scale global data to simulate customer behavior across the business. Ideally you bring experience with reinforcement learning, causal inference, and…
…experience with Machine Learning and Large Language Model fundamentals, including architecture, training/inference lifecycles, and optimization of model execution - Experience with Cloud platforms (preferably…
…We build large-scale models that simulate how our global customer base responds to change, and we get to see that work shape what…
…Our platform supports large language, vision, audio, multimodal, and mixture-of-experts models. It gives scientists and engineers the tools to move new optimization…
…You will collaborate with NVIDIA teams around the world and influence how we evaluate evolving areas such as large language models, agentic AI, accelerated…
…manage high-volume real-time and batch inference systems, ensuring optimal performance and reliability. Implement quantization techniques and deploy open-weight large language models…
…technical products. - Strong understanding of large language models and modern AI systems. Experience with model training, evaluation, or inference is highly desirable. TECHNICAL SKILLS…
…When customers train the next generation of large language models or serve billions of inference requests with tight latency SLAs on Amazon EC2 P5…
…We have built the ability to detect these defects at scale using Large Language Models (LLMs), and we report them to Amazon's most…
…with inference engineers to ensure models are servable from inception - Develop training methodologies for multimodal models that jointly process and generate speech, language, and…
…Design and evolve the architecture of Mantle's distributed inference engine, including capacity management, model onboarding pipelines, and quality-of-service controls Drive cross…
…Data modeling: exceptional ability to design logical and physical data models for large-scale ingest, retrieval, and analytical consumption — including dimensional modeling and lakehouse…
…We are seeking a highly experienced ML Engineer to build, deploy, optimize and operationalize Small and Large Language Model (LLM)-based applications, with a…
…squad alongside Researchers, Product Managers, and Designers. We are not just wrapping an API; we are building the proprietary models, the streaming architecture, and…
…Maintain data and transactions within a Warehouse Management System and create reports to support management decision making. Establish and model quality control mechanisms. Maintain…
…be working on features for the largest clusters, with the largest customers, for the largest AI models. The organization you would be joining is…
…feature engineering, modeling, probabilistic modeling, hyper-parameter tuning, scalable inference methods and latent variable models. Challenges will involve dealing with very large data sets…