Jobs
Indexed directly from employers. Every age is their own publish date.
Indexed directly from employers. Every age is their own publish date.
Indexed directly from employers. Every age is their own publish date.
Searching titles and descriptions for “Software Engineer, Inference”. A match may be a passing mention rather than the job itself. Titles only.
489 roles across 535 listings · show every listing · page 1 of 20
About the Role We're looking for a Software Engineer to build the systems that treat infrastructure as software. This role owns the software…
…Integrate new AI accelerator platforms and support inference for new model architectures Minimum qualifications Significant software engineering experience, particularly with distributed systems Results-oriented…
…machine learning systems and/or platforms. - Experience in serving LLMs using inference engines like vLLM, TensorRT-LLM, TEI, SGLang, and knowing tradeoffs between them…
We are now looking for a Senior Software Engineer for Quantized Inference! NVIDIA is seeking software engineers to accelerate the discovery and deployment of…
…software to serve inference of trained AI models running on GPUs. Contribute to the development of disaggregated serving for Dynamo-supported inference engines (vLLM…
…real-time and batch inference, powering model inference at enterprise scale. We are looking to hire high-agency engineers who bridge the gap between…
…We are seeking a Senior Software Engineer to design, build, and optimize highly scalable and reliable automation systems that ensure the peak performance and…
…5 years of experience in a formal engineering technical leadership role, leading software engineering teams. 2 years of experience in LLM training or inference…
…an engineering management role, guiding software engineering teams, including hiring or team development. 2 years of experience in LLM training or inference, including performance…
…As a Software Engineer on the Cluster Deployment Automation team, you will help build the pushbutton tooling that makes large-scale cluster deployments faster…
…software, verification, and physical design stakeholders to ensure the designs are complete, correct, and performant. Minimum qualifications: Bachelor's degree in Electrical Engineering or…
…software, verification, and physical design stakeholders to ensure the designs are complete, correct, and performant. Minimum qualifications: Bachelor's degree in Electrical Engineering or…
…Expert-level software engineering fundamentals using Python, PyTorch, or JAX, with a track record of building reliable, highly scalable ML systems. Proven ability to…
…Our first products are heavily focused on inference. Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is…
…Our first products are heavily focused on inference. Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is…
…Our first products are heavily focused on inference. Backed by hundreds of millions from top-tier investors and staffed by leading engineers, Etched is…
…This role demands a driven individual capable of navigating the complexities of selling software solutions to large enterprises, with a keen understanding of the…
…MINIMUM QUALIFICATIONS: - Bachelor’s degree in Computer Science, Engineering, or a related technical field. - 5+ years of experience in a software engineering role, with…
…Forward Deployed Engineer, Applied AI Engineer, Solutions Architect, ML Engineer with field exposure, or technical founder. - Demonstrated ability to build production software with customers…
…MINIMUM QUALIFICATIONS: - Bachelor’s degree in Computer Science, Engineering, or a related technical field. - 5+ years of experience in a software engineering role, with…
…We are looking for a Software Development Engineer who wants to work at the frontier of AI governance — building the platform that gives Amazon…
…The ideal candidate will work with engineers and applied scientists to design models that leverage large scale and unstructured data, design scalable agents for…
…Software Engineer to build efficient on-device AI software for RTX and DGX-class systems. This role focuses on high-performance local inference, low…
…in Computer Science, Computer Engineering, Software Engineering, or equivalent technical experience. 8+ overall years of experience and deep expertise in High Performance Networking, RDMA…
…10+ years of relevant professional software engineering experience, with at least 3+ years in Staff, or Lead Architect role. BS, MS, or PhD in…