We are now looking for a Senior Software Engineer for Quantized Inference! NVIDIA is seeking software engineers to accelerate the discovery and deployment of…

…The LocalAI team is seeking a Senior Systems Software Engineer to build efficient on-device AI software for RTX and DGX-class systems. This…

…fine-tuning, inference optimization, or AI platform engineering. Hands-on experience with inference optimization and model efficiency techniques such as quantization, distillation, pruning, speculative…

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another…

…The LocalAI team is seeking a Senior Systems Software Engineer to develop efficient on-device AI software for RTX and DGX-class systems. The…

…12+ years of software engineering with depth in GPU computing, ML systems, or high-performance inference Strong Python or C++ programming, software design, and…

…Engineering Group, Engineering Group > Software Applications Engineering General Summary: Job Description More details below: Join the exciting Generative AI team at Qualcomm focused on…

…Work closely with customer AI researchers, engineers, and developers to build, prototype, and deploy Agentic solutions on NVIDIA platforms. Optimize inference performance and total…

…Experience optimizing models for on-device/edge inference (quantization, pruning, distillation, or deployment on accelerators such as the Apple Neural Engine) is a strong…

…We're looking for a Senior Engineer for CoreWeave's Benchmarking & Performance team, focused on kernel authoring and optimization. You will write, profile, and…

…related AI workloads, edge AI inference, and software-defined vehicle use cases. The role requires strong software engineering fundamentals, hands-on debugging capability, structured…

Software Senior Engineer, Software Engineering AI Innovation Lab In the rapidly evolving Artificial Intelligence era, few domains are advancing faster than the AI-enabled…

…8+ years in Data Engineering, Software Engineering, or Data Science, with at least 2+ years of hands-on experience deploying GenAI/LLMs in a…

…Improve inference performance through quantization, batching, caching, model compilation, runtime tuning, and accelerator-aware optimization. Partner with systems engineers to integrate models into Cloudflare…

…Deepgram is seeking a Senior Technical Program Manager (AI Tooling & Systems) for Engineering to drive execution of large-scale ML infrastructure and AI tooling…

…It's a great fit whether you're a hands-on senior engineer who wants to go deep on the productionization problem, or a…

…This role is a great fit whether you're a hands-on senior embedded engineer who wants to go deep on a hard problem…

…and the software layers that shape local AI performance, such as inference frameworks (vLLM, SGLang, Llama.cpp, Ollama), model formats, quantization, memory management, and…

…Experience with software engineering foundations (Python/C++), containerization, AI accelerators, and profiling tools; coupled with fluency in modern inference/runtime stacks. K nowledge of…

…This role is ideal for a senior engineer who enjoys owning ambiguous, high-impact systems and pushing the cost/performance frontier of GPU inference…

…DP/PP, MoE), or memory optimizations (quantization-aware training, mixed precision) Experience integrating high-performance inference engines (vLLM, SGLang, TensorRT-LLM) into RL training…

…Allocate and distribute system resources (CPU/GPU/interconnect) to various models and inference engines running on the robot. Spearhead cross-cutting initiatives that allow…

…In this role, you will report to a Senior Staff Engineering Manager You will: Analyze model architectures and identify bottlenecks in training and inference…

…As a senior member of the team, you'll also mentor junior engineers, sharing your expertise in AI system design and best practices. About…