Jobs
Indexed directly from employers. Every age is their own publish date.
Indexed directly from employers. Every age is their own publish date.
Indexed directly from employers. Every age is their own publish date.
Searching titles and descriptions for “Engineering Manager, Inference Benchmarking — AI Perf”. A match may be a passing mention rather than the job itself. Titles only.
267 roles · group by role · page 1 of 11
…NVIDIA’s open-source benchmarking platform, AIPerf, is the growing standard for assessing LLM serving performance across various inference frameworks. Hyperscalers, cloud providers, and…
…research engineers through other technical leaders — developing tech lead managers or equivalent, setting direction across sub-teams — while staying technically influential yourself. - AI as…
…Collaborate with world-class engineers and AI researchers who thrive on curiosity and innovation. Fireworks AI is an equal-opportunity employer. We celebrate diversity…
…Order Management/Billing, and Product. WHY FIREWORKS? - Solve Hard Problems: Tackle challenges at the forefront of AI infrastructure, from low-latency inference to scalable…
…through engineering teams Security event investigation : triage, root cause assessment, and remediation ownership Vulnerability management lifecycle: scanning, prioritization, tracking, and closure AI/ML security…
…Collaborate with world-class engineers and AI researchers who thrive on curiosity and innovation. Fireworks AI is an equal-opportunity employer. We celebrate diversity…
…Inferentia and Trainium Systems — delivering high-performance ML inference and training at cloud scale. We’re looking for a Senior Manager, Physical Design Engineering…
…We’re hiring a PM to work on our core inference product and general platform, spanning inference performance and control, accounts and fraud reduction…
…Drive new business opportunities where compute bottlenecks, network bandwidth limitations, or bare-metal performance requirements are the barrier to scaling AI training and inference…
…Management, Technical Program Management, Research Operations, Solutions Engineering, or a similar technical, customer-facing role. Experience operating in an ML research or AI infrastructure…
…You will work at the intersection of design, engineering, and creative systems, building and evolving AI-enabled tools and intelligent workflows that help teams…
…Hands-on experience with Python, PyTorch and GPU-accelerated training, inference, performance optimization, or serving. Research and engineering judgment, with the ability to find…
…Build and optimize the continuous autoregressive serving loop, including per-step control inputs, model and KV-cache state management, GPU inference, frame streaming, and…
…Collaborate with world-class engineers and AI researchers who thrive on curiosity and innovation. Fireworks AI is an equal-opportunity employer. We celebrate diversity…
We are looking for a Senior Inference Engineer to own inference for real-time multimodal conversational AI. This is a full-stack inference role…
…profiling, and debugging solutions Performance optimization and benchmarking Validation, quality, and release engineering Partner with silicon architecture and hardware engineering teams to co-design…
…NICE TO HAVE - Experience selling into engineering leaders, product leaders, founders, or AI/ML teams. - Experience supporting AI-native, developer-tooling, data infrastructure, cloud…
…an engineering role. But it requires genuine curiosity about how AI inference platforms work. You'll need working fluency in model serving, inference optimization…
…Requirements Bachelor's or Master's degree in Computer Science, Computer/Electrical Engineering, or a related field 3+ years in AI performance engineering, with…
…Desirable Requirements Knowledge of AI/ML or HPC performance engineering, including benchmarking and scripting (e.g., Python, Bash) on Linux and hands-on experience…
…and platform engineering, specifically managing the lifecycle of certified datasets and downstream consumer contracts. Exposure to LLM agent tooling and benchmarking, with a focus…
…management, and hardware-software co-design. This is a role for engineers who build the foundational software stack that unlocks the full performance potential…
…Benchmark the benchmarking infrastructure itself. BI & Reporting (secondary) - Where needed, build self-service views (Grafana, Looker, or similar) for engineers, product managers, and executives…
…outcomes Experience managing AI infrastructure and capacity including GPU/CPU used for training, benchmarking and inference Demonstrated ability to integrate AI tools to optimize…
…Engineering, or Mathematics (STEM), or experience in defining and creating benchmarks for assessing GenAI model performance - Ability to recognize opportunities where generative AI could…