Jobs
Indexed directly from employers. Every age is their own publish date.
Indexed directly from employers. Every age is their own publish date.
Indexed directly from employers. Every age is their own publish date.
Searching titles and descriptions for “Manager, Large Language Model Inference”. A match may be a passing mention rather than the job itself. Titles only.
116 roles across 129 listings · show every listing · page 1 of 5
…lead the architecture and execution of large-scale ML infrastructure, requiring a deep understanding of Large Language Model (LLM) operations from chip level to…
…Engineering Manager, you will lead the architecture and execution of large-scale ML infrastructure, requiring a deep understanding of Large Language Model (LLM) operations…
…8+ years of hands-on experience designing, training, and scaling deep learning models, with at least 3+ years focused deeply on training Large Language…
…LLMs, vision-language, TTS, ASR, and diffusion AI workloads. Perform end-to-end optimization of AI models, data pipelines, and inference runtimes to enhance…
…Hands-on experience with large-scale model training, fine-tuning, inference optimization, or AI platform engineering. Hands-on experience with inference optimization and model…
…gateway, routing, or traffic management systems. Familiarity with the current AI ecosystem: model providers, model capabilities, agent frameworks, inference patterns, and the rough edges…
…experience in a relevant role Fluency in causal inference and experimentation, with hands-on experience modeling price elasticity or willingness-to-pay Prior exposure…
…one programming language (e.g., Python, R) Strong background in experimentation design, causal inference, and statistical analysis Experience working with large-scale data pipelines…
…of programming experience in a relevant language or 3+ years of experience + PhD Experience building and scaling large-scale software systems, including successfully deploying…
…of programming experience in a relevant language or 3+ years of experience + PhD Experience building and scaling large-scale software systems, including successfully deploying…
…models for specific tasks and behaviors without degrading their reasoning capabilities. - Experience with machine translation, multilingual NLP, or language quality estimation. - Familiarity with inference…
…Developing data pipelines and integrating large-scale data, training, and inference systems Collaborating with ML teams to productionize models and ensure seamless integration across…
Engineering Manager, Foundation Model Inference (FMAPI) RDQ427R519 At Databricks, we are driven by a passion to empower data teams in tackling the world's…
…We leverage traditional encoder models, RAG based retrieval and large language models to identify and moderate sensitive content in real-time across text, images…
…anomaly detection, classification, graph neural networks, temporal modeling, or causal inference - Familiarity with LLM fine-tuning, reward modeling, or feedback signal design - Familiarity with…
…LLM, vision-language, TTS, ASR, and diffusion-based AI workloads. Perform end-to-end optimization of AI models, data pipelines, and inference runtimes to…
…Drive adoption of model optimization techniques such as quantization, pruning, sparsity, and distillation to enable efficient deployment of large models on local and edge…
…models from various sources, efficiently manage a local model repository, and create automated synchronization mechanisms to keep the repository up to date. Analyze large…
…Work with petabyte-scale data from Samsara camera and sensor devices to develop new models. Optimize models for inference on the backend and/or…
…production areas Managing data and transactions within a Warehouse Management System and creating reports to support management decision making Establishing and modeling quality control…
…training and evaluation datasets for language model–based systems. - Operationalize fine-tuning and evaluation workflows for large language models behind member-facing features such…
…inference Deep understanding of multi-threaded system design — GCD, async/await, actors, and thread-safety patterns — critical for running computationally intensive AI models locally…
…the industry for Large Language Models and GenAI Services. Key areas that we are working on Building and Scaling our Inferencing Cloud across our…
…design and build large-scale infrastructure that powers foundation model training, fine-tuning, evaluation, and inference. You will develop model inference and fine-tuning…
…Amazon's largest advertisers globally. - Greenfield architecture: The advertiser context center is being built now, you'll shape the data models, retrieval patterns, and…