Jobs
Indexed directly from employers. Every age is their own publish date.
Workplace
Age
Searching titles and descriptions for “Software Engineer, Inference”. A match may be a passing mention rather than the job itself. Titles only.
113 roles across 114 listings · show every listing · page 1 of 5
1.3ySoftware Engineer, Inference - Multi Modal…About the Role We’re looking for a software engineer to help us serve OpenAI’s multimodal models at scale. You’ll be part…
2.1yStaff Software Engineer, Inference Cloud…Raise the effectiveness of senior engineers through design feedback, pairing, and clear technical standards. Skills & Qualifications - 8+ years of experience in software engineering, with…
1.2yInference Software Engineer…Our first products are heavily focused on inference. Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is…
- 1.5ySoftware Engineer, Model Inference
…efficient model inference, as well as accelerating research progression via model inference. About the Role We are looking for an engineer who wants to…
1.9ySoftware Engineer - Training/Inference (C++)…Experience with GPU inference engines (vLLM, SGLang, Triton, TensorRT-LLM, etc.). Strong background in system optimizations: batching, caching, load balancing, parallelism. Low-level inference…
1.9ySoftware Engineer, AI Inference…Position Overview We are looking for a Software Engineer to work at the forefront of deploying our cutting-edge AI models, enhancing the performance…
2.1ySoftware Engineer - Dedicated InferenceBasetenEPDSan Francisco; Toronto; New York; Montrealhalf of Baseten’s roles are under 2 monthsHybrid…Join us and help build the platform engineers turn to to ship AI products. THE ROLE As a Product Engineer on the Dedicated Inference…
- 1ySoftware Engineer - Enterprise PlatformBasetenEPDSan Francisco; Toronto; New York; Montrealhalf of Baseten’s roles are under 2 monthsHybrid
ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer…
1yStaff Infrastructure Software Engineer, Enterprise AI…Proven experience in a senior role, with 5+ years of full-time software engineering experience. Deep understanding of modern infrastructure practices, including CI/CD…
1ySoftware Development Engineer, ML Systems, Annapurna Labs…AWS Neuron is the software of Trainium and Inferentia, the AWS Machine Learning chips. Inferentia delivers best-in-class ML inference performance at the…
- 1ySr. ASIC Design Engineer, Cloud-Scale Machine Learning Acceleration team
…in Electrical Engineering or related technical field - 5+ years in RTL design for SOC - 5+ years of VLSI engineering - 5+ years with code quality…
- 1ySenior ML Kernel Performance Engineer
…Working at the hardware-software boundary, our engineers craft high-performance kernels for ML functions, ensuring every FLOP counts in delivering optimal performance for…
- 1yPhysical Design Engineer
…Our first products are heavily focused on inference. Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is…
- 1yTechnical Lead, GenAI - Autonomous Vehicles
…Engage with partner software organizations, from engineering teams to technical leaders, and decision-makers to understand their goals, solve technical challenges, and promote best…
- 1yASIC Architect
…Our first products are heavily focused on inference. Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is…
1.1ySoftware Engineer, Product…ABOUT THE ROLE As a software engineer at Wispr, you’ll play a crucial role in building the first capable, habit forming voice interface…
- 1.1ySoftware Engineer - Real-Time Storage
…Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity…
- 1.1yCore Software Engineer
…Our first products are heavily focused on inference. Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is…
1.1yStaff Software Engineer - ML ObservabilityDatadogEngineeringBoston, Massachusetts, USA; New York, New York, USAhalf of Datadog’s roles are under 2 months…You will shape product direction, drive experimentation, and apply your deep understanding of both AI systems and software engineering to solve open-ended problems…
1.1ySenior Staff Data Scientist, Guest & Host Marketplace AI…Guest Experience is responsible for Search and Discovery, Merchandising, and end-to-end online software experience worldwide from top-of-funnel discovery through post…
1.1ySoftware Engineer, Distributed Systems…You are an experienced software engineer who thrives on building large-scale computing platforms. You have deep expertise in large scale distributed systems that…
- 1.1ySenior Software Engineer, Product
…a unified platform where high-performance inference, orchestration, and observability come together to unlock new categories of AI-native products. As generative media reshapes…
1.1ySenior Software Engineer, Routing…We continuously refine our routing engine to calculate more efficient routes, deliver highly accurate ETAs, and manage scalable traffic for every journey, adapting as…
- 1.1yFull Stack LLM Engineer
…About the Role We are seeking a versatile and experienced engineer to join our Inference Core Model Bringup team. This team is responsible to…
- 1.1ySoftware Engineer, Caching Infrastructure
…We’re looking for an experienced engineer to help design and scale this critical infrastructure. The ideal candidate has deep experience in distributed caching…