Achyut Sarma Boggaram

Sr. Machine Learning Engineer

Achyut Boggaram is a Senior Machine Learning Engineer and Team Lead at Torc Robotics, where he architects scalable ML frameworks for autonomous vehicles. His work focuses on efficient multimodal, multi-task learning systems that power self-driving trucks. A leader in the AI community, he organizes the AI Tinkerers—Austin Chapter and speaks at major industry events. Shashidhar Shenoy is a Tech Lead at Google with over a decade of experience in distributed systems and ML infrastructure. He has led high-impact cloud and AI/ML initiatives and holds patents in wireless communication. Together, they bring deep, practical insight into ML infrastructure at scale.

---

Presentation

Navigating Bottlenecks: Infrastructure Lessons from AV ML Systems

Autonomous Vehicle (AV) ML systems demand infrastructure that can handle real-time perception, high-throughput data, and latency-critical workloads. While model optimization gets much attention, infrastructure bottlenecks often define system performance. This talk shares lessons from scaling AV ML pipelines using Kubernetes-native tools. We’ll cover orchestration with Dagster, distributed execution via Ray, and dynamic GPU scaling with Kueue and KubeRay. From cloud-based fleet learning to edge-deployed perception, we’ll explore how to balance performance, cost, and developer velocity. If you’re building or maintaining AV ML systems, this session offers practical strategies to move fast, without compromising safety or scalability.