As generative AI shifts from training to enterprise-scale inference, a hidden bottleneck is putting ROI at risk.

GPUs offer immense computational power, but they're frequently constrained by memory limitations. According to Penguin Solutions, this can leave expensive compute cycles up to 70% idle. The result is a "memory wall" that gets worse as context windows grow and user concurrency increases, stalling performance and inflating costs.

Join Penguin Solutions for a practical look at what’s causing the memory wall, why it becomes more costly at scale, and what you can do about it.

Why attend?

  • The memory wall is easy to miss and expensive to ignore. As inference workloads scale, memory constraints (not raw compute) become the limiting factor for GPU performance.
  • Disaggregated memory architecture changes the economics. Penguin Solutions reports performance improvements of up to 8x using this approach.
  • There's a practical path forward. Learn concrete infrastructure decisions that support scalable, high-performance AI inference, without over-provisioning compute you don't need.

What you'll learn

  • Why memory, not compute, is the real constraint behind slow or costly AI inference at scale
  • How Penguin Solutions' MemoryAI™ KV Cache Server is designed to boost inference performance by up to 8x
  • How disaggregated memory architecture can reduce total cost of ownership, with Penguin Solutions citing reductions of up to 39%
  • How to shift AI infrastructure spend from a pure cost center toward a scalable engine for growth

Speakers

Andy Mills
VP, Advanced Product Development, Penguin Solutions
Andy leads the Advanced Memory Product Development team at Penguin Solutions, where he's responsible for the roadmap and development of the MemoryAI family of memory appliances, CXL add-in cards, and memory appliance fabric management software stacks.

Torry Steed
Sr. Product Marketing Manager, Penguin Solutions
Torry is Senior Product Marketing Manager at Penguin Solutions, focused on the SMART CXL and advanced memory portfolio. He leads product marketing, roadmap development, business development, and product management across the Integrated Memory business.