Jobs
Indexed directly from employers. Every age is their own publish date.
Indexed directly from employers. Every age is their own publish date.
Indexed directly from employers. Every age is their own publish date.
Searching titles and descriptions for “Software Engineer, Model Routing & Inference”. A match may be a passing mention rather than the job itself. Titles only.
232 roles across 263 listings · show every listing · page 2 of 10
…Hardware-software co-design Systems for AI/ML S ystems Infrastructure for large LLM training and inference Systems/AI algorithms codesign (e.g., for…
…Hardware-software co-design Systems for AI/ML Systems Infrastructure for large LLM training and inference Systems/AI algorithms codesign (e.g., for sparsity…
…As an AWS Lead Software Engineer-Full Stack/Java/SpringBoot at JPMorgan Chase within Commercial and Investment Banking's Payments Technology team, you are…
…Software Engineering and AI/ML to drive awareness and use of new and leading-edge technologies (MLOps, LLM patterns, feature stores, observability, model monitoring…
…inference and training cost models (COGS, utilization, throughput per GPU). Background building automation, control planes, or orchestration platforms from 0→1. Software Engineering M6…
…develop next-generation models Integrate new AI accelerator platforms and support inference for new model architectures Minimum qualifications Significant software engineering experience, particularly with…
…About the Role Fireworks AI is one of the industry leaders in inference and training for open models. Open models are how the rest…
…models—to resolve routine tickets, maintain knowledge bases, and significantly boost internal productivity. - Infrastructure & Hardware Ownership: Manage hardware logistics, global device lifecycles, software license…
…software systems that have been successfully delivered to customers, or experience with Machine Learning and Large Language Model fundamentals, including architecture, training/inference lifecycles…
…The Role This role is for a Software Engineer who will design, implement, and operate globally distributed systems that enable Leo to achieve low…
…prefill-decode separation, remote KV-Cache access over RDMA/RoCE, and N-S token routing for mixture-of-experts models. Familiarity with DPU-based…
…and mentor other engineers. Ways To Stand Out From The Crowd: Experience building platforms for AI/ML training, inference, model serving, GPU-accelerated workloads…
…route policies, communities, filtering, traffic engineering, and failover - Announce customer and company IP ranges from physical infrastructure and cloud providers, including BYOIP integrations - Establish…
…software engineering experience, with demonstrated experience in distributed systems, backend platforms, infrastructure, or comparable technical environments. - Very strong foundational knowledge of large language models…
…modeling), Bluebeam, and construction software tools. Proficient in using data analytics and internal reporting tools, such as PowerBI, Compass Cx and other statistical inference…
…Hands-on experience building applications on foundation models (RAG pipelines, agent frameworks, prompt engineering, model evaluation, fine-tuning) is required. A strong mathematics and…
…Strong software engineering fundamentals and programming skills Demonstrated experience in Golang development and with distributed computing Proficiency in working with information/data models Strong…
…Infrastructure Engineering team, you will drive end-to-end performance characterization, bottleneck analysis, and optimization of large-scale AI training and inference clusters. In…
…quality improvements) Experience with pre-silicon software development — architectural simulators, FPGA emulation, performance modeling — and with hardware/software co-design cycles Familiarity with ML…
…Software Engineering and AI/ML to drive awareness and use of new and leading-edge technologies (MLOps, LLM patterns, feature stores, observability, model monitoring…
…engineers to package portions of it for deployment with internal and external customers. Own the reliability of our agentic infrastructure: agents, sessions, model routing…
…engineers to package portions of it for deployment with internal and external customers. Own the reliability of our agentic infrastructure: agents, sessions, model routing…
…engineers, and engineering leaders to scale our GenAI footprint efficiently and securely. In this role, you will have the opportunity to: - Build model-routing…
…inference at scale — inference efficiency, model right-sizing, batching, quantization, or multi-model routing Experience with capacity and cost economics, including infrastructure cost modeling…
…Experience with open tool-integration protocols, plugin or skill frameworks, and model-routing or gateway layers. Background in developer experience or platform engineering, observability…