Jobs
Indexed directly from employers. Every age is their own publish date.
Workplace
Age
Searching titles and descriptions for “Software Engineer, Inference”. A match may be a passing mention rather than the job itself. Titles only.
2,253 roles across 2,585 listings · show every listing · page 1 of 91
29dSoftware Engineer, InferenceYou'll own how Luma's models get served — integrating new architectures into the inference engine, scaling deployments across thousands of machines, and keeping…
3dSoftware Engineer, Inference (AI Data Engineering)…SOFTWARE ENGINEER, INFERENCE (AI DATA ENGINEERING) The application software team is the central nervous system of SpaceX – we create mission critical applications that are…
2moSoftware Engineer, Inference Platform…About the Role We're hiring a Software Engineer to help contribute to projects on our Inference Platform team. Our team primarily owns the…
4moSoftware Engineer, Inference - Performance OptimizationAbout the Team Our team analyzes inference stack performance across the application, model, and fleet layers to identify bottlenecks and drive faster, cheaper inference…
10moSoftware Engineer, Inference AI/ML…Curiosity about GPU inference concepts (micro-batching, KV cache, streaming). Preferred: Internship or project that deployed a microservice or ML inference demo. Coursework/research…
- 1.3ySoftware Engineer, Inference - Multi Modal
…About the Role We’re looking for a software engineer to help us serve OpenAI’s multimodal models at scale. You’ll be part…
2dStaff Software Engineer, Inference Performance Optimization, GenAI, DeepMindGoogleMountain View, CA, USA
2dStaff Software Engineer, Inference / Compute Infrastructure EngineeringAbout the Role We're looking for a Software Engineer to build the systems that treat infrastructure as software. This role owns the software…
5dStaff + Senior Software Engineer, Inference…Integrate new AI accelerator platforms and support inference for new model architectures Minimum qualifications Significant software engineering experience, particularly with distributed systems Results-oriented…
- 13dSenior Deep Learning Software Engineer, Inference
NVIDIA seeks a Senior Software Engineer specializing in Deep Learning Inference for our growing team. As a key contributor, you will help design, build…
- 54dStaff + Senior Software Engineer, Inference Deployment
…Integrate new AI accelerator platforms and support inference for new model architectures Minimum qualifications Significant software engineering experience, particularly with distributed systems Results-oriented…
- 2moSr. Staff Software Engineer, Inference Platform
…About the Role We're hiring a Staff Engineer to help lead, drive, and contribute to projects on our Inference Platform team. Our team…
- 2moStaff+ Software Engineer, Inference RuntimeAnthropicSoftware Engineering - InfrastructureRemote-Friendly (Travel-Required) | San Francisco, CA | Seattle, WA | New York City, NY
…qualifications 8+ years of software engineering experience, with significant time as the technical lead or anchor on a platform, inference runtime, or ML infrastructure…
- 4moStaff Software Engineer, Inference
…As a Staff Software Engineer (IC5) on the Inference team, you will act as a technical leader driving architecture, performance, and reliability across multiple…
- 5moStaff Software Engineer, InferenceAnthropicSoftware Engineering - InfrastructureDublin, IE+1 more listingoldest open 7 monthshalf of Anthropic’s roles are under 46 days
…As a Staff Software Engineer on our Inference team , you will work end to end, identifying and addressing key infrastructure blockers to serve Claude…
7moStaff Software Engineer, Inference InfrastructureCohereInferenceSan Francisco; London; New York; Toronto; Montrealhalf of Cohere’s roles are under 47 daysHybrid…Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft. We are a global technology company headquartered…
- 11moSenior Software Engineer, Inference
…Senior engineers are area owners who lead designs, raise engineering standards, and deliver measurable improvements to latency, throughput, and reliability across multiple services. You…
- 2.1yStaff Software Engineer, Inference Cloud
…Raise the effectiveness of senior engineers through design feedback, pairing, and clear technical standards. Skills & Qualifications - 8+ years of experience in software engineering, with…
5dSenior Software Development Engineer, AI/ML, AWS Neuron, Model Inference…Inferentia silicon and servers. Strong software development using Python, System level programming and ML knowledge are both critical to this role. Our engineers collaborate…
- 6dSr. Software Development Engineer, Inference Team - AWS Neuron
…This senior software engineering role is part of the Machine Learning Inference Applications team and focuses on delivering high-performance model inference solutions for…
- 9dSoftware Dev Engineer, Items and Offers Platform, Relationship Inference and Correction
…software development engineer or related occupational experience - 1+ years of Object Oriented Design experience - Bachelor's degree or foreign equivalent in Computer Science, Engineering…
- 10dSoftware Engineer, Model Inference, DeepMindGoogleLondon, UK; Mountain View, CA, USA
11dSoftware Engineer, ML Inference Platform…Maintain an in-house ML inference platform to serve large language models efficiently. Maintain an in-house ML compiler platform to compile, deploy, and…
- 11dSenior/Staff Software Engineer, ML Inference Platform
…Maintain an in-house ML inference platform to serve large language models efficiently. Maintain an in-house ML compiler platform to compile, deploy, and…
- 16dSoftware Development Engineer, AI/ML, AWS Neuron, Model Inference
…Inferentia silicon and servers. Strong software development using Python, System level programming and ML knowledge are both critical to this role. Our engineers collaborate…