Technology

The Photonic Fabric™

As AI models grow at an unprecedented pace, traditional data center infrastructure is strained to its limits. The explosive growth in AI model size is driving the need for a step function increase in memory bandwidth and capacity at low latencies. Celestial AI has been collaborating with some of the largest hyperscalers to develop a deep understanding of compute, memory and network system infrastructure chokepoints. These collaborations led to the development of Photonic Fabric solutions that address the problem of our time for Accelerated Computing: the AI Memory Wall. 

The Photonic Fabric is the only industry solution with the ability to shatter the “Memory Wall” and deliver data directly to the point of compute, while supporting current HBM3E and next-generation HBM4 bandwidth and latency requirements at very low single-digit pJ/bit power.

Memory Wall

Before GPT-2, AI infrastructure was constrained by available computing cycles. However, Post-GPT the size of the AI models is growing exponentially, transitioning us into an era where memory and interconnect bandwidth are the primary limitations instead of computing. In close collaboration with hyperscalers Celestial AI has developed the revolutionary Memory Fabric that shatters the memory wall.

Memory and Compute Fabric

Celestial AI’s Memory Fabric is the only solution available today that shatters the “Memory Wall,” offering tens of terabytes of optically scalable memory capacity, supporting current HBM3e and future HBM4 bandwidth and latency requirements. The Compute Fabric enables clusters of hundreds of GPUs or AI accelerators to be optically interconnected with industry-leading bandwidth at extremely low latency and energy consumption.

Photonic Fabric optical chiplets can be integrated as an initial phase of technology adoption. This integration requires no software change and is directly compatible with customer logical protocols and existing multi-chip packaging flows. Customers are excited about the roadmap to deeper integration of Photonic Fabric technology in their system architectures, offering as much as 25x increase in off-package bandwidth compared to other available state-of-the-art technologies.