Home / Blog / Inside AI Infra Summit 2025: Scaling Compute, Moving Data, Powering the Future

Inside AI Infra Summit 2025: Scaling Compute, Moving Data, Powering the Future

by Ian Smythe,
VP Product Marketing and Strategic Alliances
This year’s AI Infra Summit underscored just how quickly the world of compute is evolving, and how central infrastructure has become to sustaining that growth. The event was well attended, packed with the ecosystem’s leading voices, and it felt like the right nexus of innovation, technology and market needs – where the future of AI infrastructure is being defined. There was intense focus not just on the processing technology driving the next wave of AI compute, but also on the infrastructure and systems required to deliver that compute at scale, as well as the software optimization and the tooling needed. What made the summit especially valuable was the way it brought startups and established players together across the entire ecosystem, creating a unique space for collaboration, debate, and vision-sharing on how to power the next generation of intelligent systems.

Key Themes from the Summit

The tone was clear across sessions and keynotes: AI is driving unprecedented compute demand, and infrastructure must scale in new ways to support it. 

  • Explosive Compute and Data Movement Needs. From Meta and NVIDIA, the message was unmistakable: AI workloads will continue to demand even more compute. That translates directly into more data centers, higher density, and exponential data movement challenges. The example of the Vera Rubin AI processor clusters, pushing 1.75 PB/s bandwidth and requiring 75 TB of memory, showed the scale of what’s already here. 
  • Rack-Scale Innovation. AWS highlighted the industry’s trajectory toward rack-scale switching with 10 PB/s bandwidth and 10 µs latency. This shift redefines performance expectations, dwarfing where the industry has been and reinforcing how much further there is to go. 
  • New Tools for Chip Design. Cadence shared how AI is now being used to design AI chips, closing the loop between compute demand and design capability. As systems grow in complexity, these innovations are essential to keep pace with what the next generation of AI workloads will require. 

Where Baya Fits

Inside AI Infra Summit

In this context, the conversations at the Baya booth took on even greater importance. With demonstrations of our software-driven, scalable data movement solutions, we showed how Baya is addressing one of the most pressing challenges in AI infrastructure: moving data efficiently at massive scale. Our fabric IP and tools are designed to give system architects the flexibility to explore new architectures, optimize compute efficiency, and reduce bottlenecks that otherwise limit system performance. 

What resonated most with visitors was how seamlessly our approach can be integrated into diverse design flows, whether for AI accelerators, cloud and data center platforms, or edge applications, making Baya not just a niche solution, but a foundational enabler for the future of compute. The deep technical and commercial discussions we had confirmed that data movement has become a first-class design concern, and that Baya is well-positioned to help customers and partners navigate this transition. 

The summit also provided opportunities for Baya to share its perspective more broadly. I had the privilege to speak on the panel RISC V: Alternative Architectures for Efficient System Scaling, highlighting how open standards and chiplet ecosystems are shaping future architectures, and our team also spoke at the Synopsys AI Chip Design Startup Forum, where we shared insights on what it takes to build and scale an AI startup from the first idea through tape-out and beyond. This discussion resonated strongly with the audience, offering practical lessons, candid perspectives, and inspiration for entrepreneurs and innovators navigating the complex journey of bringing advanced semiconductor and AI solutions to market.

Look out for the recordings of these panels, which will be available soon. 

What a week!

On a personal note, it was the perfect way to begin my journey with Baya. I’m delighted to have joined as VP of Product Marketing, and I’ve been deeply impressed by the impact Baya already has in the ecosystem. Meeting our customers last week only reinforced my excitement about the opportunities ahead, and it was equally inspiring to spend time with the amazing Baya team, a group of experts driving scalable data movement solutions into the heart of AI infrastructure. 

The AI Infra Summit showed the scale of the challenge and the ambition of the solutions. At Baya, we’re excited to play a defining role in this journey. 

What a week one, and it’s just the beginning! 

by Ian Smythe
VP Product Marketing and Strategic Alliances