Scale GP is building the infrastructure that makes enterprise AI seamless. We are looking for a Senior or Staff Infrastructure Engineer to act as…

…of AI acceleration technology This is an opportunity to work on cutting-edge products at the intersection of machine-learning, high-performance computing, and…

…Evaluate PPA (performance, power, area) for hardware features and system-level architectural trade-offs. Work closely with peer architecture teams and product management to…

…a unified platform where high-performance inference, orchestration, and observability come together to unlock new categories of AI-native products. As generative media reshapes…

Who We Are Nuro believes self-driving vehicles are the most immediate and profound opportunity for AI to drive positive change in the physical…

…optimizing ML inference and other GPU workloads on embedded compute (e.g., CUDA, TensorRT) - Experience with Rust in production or performance-critical systems - Prior…

ABOUT THE ROLE Anyscale is seeking a Senior / Staff Product Manager to lead Ray Data, our scalable data processing library for ML and AI…

…Design and implement daemons, frameworks, and system services that orchestrate AI-driven components and manage data, communication, and performance across distributed systems Prototype and…

…serve AI cloud services, such as on-demand + managed Kubernetes and Slurm clusters. This platform serves both our internal StaaS products (inference, fine-tuning…

…inference engine with state-of-the-art AI cloud infrastructure. The Together Cloud team builds the Together GPU Clusters product, which provides high-performance…

…generation of storage for AI: training, inferencing, KV cache, RAG and more. Utilizing the best from NVIDIA's network products, DPUs and NICs, working…

…Offer valuable insights on product features, functionality, and performance, contributing regularly to discussions about product strategy and architecture. Conduct periodic technical reviews and assessments…

…Offer valuable insights on product features, functionality, and performance, contributing regularly to discussions about product strategy and architecture. Conduct periodic technical reviews and assessments…

…performance networking engironments. Experience with managing infrastructure networking, Kubernnetes CSI management, and private networking concepts Familiar with NVIDIA GPUs typically used in AI/ML…

…in product management or technical product marketing of AI/ML products Deep understanding of modern data center architectures, accelerated computing, distributed inference, deep learning…

…You'll collaborate closely with other data scientists, engineers, and product managers to drive projects that unlock value from our unique, rich, and rapidly…

…12+ years of total experience in technology with previous product management, AI related engineering, design or development experience highly valued BS or MS or…

…and/or AI applications, applying deep expertise in distributed systems. Analyse and troubleshoot production workloads at the code level, optimise for performance, reliability, latency…

…Proven track record of successfully deploying and optimizing LLM models for inference in production environments. In-depth understanding of state-of-the-art language…

…request routing, load balancing, caching, batching, and traffic management for AI inference workloads. - Reliability & Performance. Architect active-active systems with rapid failover, graceful degradation…

…infrastructure and control planes to support rapid product and ML growth - Design inference infrastructure that keeps AI workloads fast, reliable, and cost-efficient - Build…

…skills NICE TO HAVE: - Experience with developing, running, and managing orchestration systems like Airflow and Flyte that non engineers can use to build data…