Jobs
Indexed directly from employers. Every age is their own publish date.
Indexed directly from employers. Every age is their own publish date.
Indexed directly from employers. Every age is their own publish date.
Searching titles and descriptions for “Software Engineer, Model Routing & Inference”. A match may be a passing mention rather than the job itself. Titles only.
36 roles across 45 listings · show every listing · page 1 of 2
…Deepgram’s voice-native foundation models are accessed through cloud APIs or as self-hosted and on-premises software, with unmatched accuracy, low latency…
…Partner with engineers to productionize models, decision systems, data products, and experimentation infrastructure. Own post-launch decision quality by monitoring model and KPI performance…
…experience reasoning about model routing, inference cost, and latency tradeoffs in production Strong software engineering fundamentals: distributed systems, API design, and testing discipline Comfort…
…The Qualcomm Cloud AI team is developing hardware and software solutions for Inference Acceleration. We are hiring LLM Serving Engineers at multiple levels to…
…The Qualcomm Cloud AI team is developing hardware and software solutions for Inference Acceleration. We are hiring an AI Performance Engineers at multiple levels…
…The Qualcomm Cloud AI team develops hardware and software platforms enabling efficient inference of large-scale foundation models. We are seeking a Staff Engineer…
…Inference Acceleration. We are seeking an ambitious, bright and innovative engineer who has delivered commercial software and experience spanning design, compiler technology, performance modeling…
…Design, train, and deploy machine learning models for Optical Systems applications Build and maintain ML pipelines for data ingestion, feature engineering, training, and inference…
…Design, train, and deploy machine learning models for Optical Systems applications Build and maintain ML pipelines for data ingestion, feature engineering, training, and inference…
…Cloud (VPC) design, subnet segmentation, routing layers, and egress controls Additional Areas You'll Contribute To Threat modeling and secure design assessments for new…
…of the AI lifecycle, from model onboarding and deployment to inference, capacity management, and operations. Through intelligent routing, caching, telemetry, and platform innovation, we…
…calls Claude, routes tool calls, manages context (caching, compaction, memory), and recovers from errors. Harnesses encode assumptions about what the model can't yet…
…influence without authority through strong engineering judgment, structured problem-solving, and crisp stakeholder communication.Comfort working across time zones and blended onsite/offshore models…
…software development engineer or related occupational experience - 1+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications…
…experience reasoning about model routing, inference cost, and latency tradeoffs in production Strong software engineering fundamentals: distributed systems, API design, and testing discipline Comfort…
…SOFTWARE ENGINEER, INFERENCE (AI DATA ENGINEERING) The application software team is the central nervous system of SpaceX – we create mission critical applications that are…
…On-device client frameworks hand requests to a cloud service that attests, routes, and orchestrates them; an inference engine serves them; and model runtimes…
…The work spans the model lifecycle: inference, post-training, and the systems that tighten the loop between them. - Act as each account's de…
…influence without authority through strong engineering judgment, structured problem-solving, and crisp stakeholder communication. Comfort working across time zones and blended onsite/offshore models…
…As a Lead Software Engineer at JPMorganChase within the Commercial & Investment Bank, you are an integral part of an agile team that works to…
…context and mobility patterns Develop on-device machine learning models for place inference, route prediction, and behavioral forecasting that operate within strict power and…
…The Role This role is for a Software Engineer who will design, implement, and operate globally distributed systems that enable Leo to achieve low…
…This role is for a Software Engineer who will design, implement, and operate globally distributed systems that enable Leo to achieve low single-digit…
…As a Software Development Engineer, you'll have the exciting opportunity to leverage industry-leading technologies — including real-time ML inference, large-scale distributed…
…Hardware-software co-design Systems for AI/ML S ystems Infrastructure for large LLM training and inference Systems/AI algorithms codesign (e.g., for…