Tag: CXL 2.0

  • Meta fights soaring hardware costs by reusing old DDR4 server memory in new DDR5-only servers — custom CXL 2.0 chip marries legacy DDR4-2400 with cutting-edge DDR5-6400

    The relentless pursuit of cutting-edge technology often runs headfirst into supply chain realities, and nowhere is this more evident than in the high-performance memory market. As the demand for high-speed DDR5 memory continues to outpace supply, some giants are finding ingenious ways to work around the shortage while keeping their systems running at peak capacity.

    One of the most creative solutions comes from Meta, which is tackling the cost and availability of legacy components by creatively repurposing old hardware. Instead of waiting for scarce DDR5 chips, Meta is recovering memory modules from decommissioned servers and integrating them into new machines using a proprietary custom chip called the Vistara ASIC.

    This custom ASIC acts as a bridge, allowing older DDR4 memory modules to seamlessly connect with newer servers running cutting-edge AMD EPYC ‘Turin’ processors, which are built exclusively for DDR5. Essentially, Meta has engineered a high-tech translation layer that makes the old and the new speak the same language.

    The Vistara technology isn’t just an adapter; it’s a sophisticated memory expander designed for efficiency. It implements a CXL 2.0 Type-3 memory expander over a PCIe 5.0 x16 interface, managing two independent DDR4 memory channels and allowing up to 256 GB of capacity using modules that are significantly smaller than what traditional solutions might require.

    By optimizing the entire process, Meta’s team has achieved remarkable efficiency. They managed to minimize protocol overhead and queuing delays, driving down latency to around 50ns. Furthermore, the ASIC incorporates advanced reliability features, including Reed-Solomon error correction and x4 chip-kill support, ensuring that this memory transition is both powerful and robust.

    The practical result for hyperscalers is staggering. Meta deploys Vistara in its MemServer platform, where two such ASICs connect to a single 158-core processor. This setup allows each server to combine vast local DDR5 memory with 256 GB of CXL-attached DDR4 memory, effectively expanding the system’s total capacity up to 1 TB.

    But Meta is not alone in pioneering this kind of hardware flexibility. A startup named Panmnesia, based in South Korea, is developing an entirely different approach to scaling memory pools through advanced CXL technology. While proprietary solutions like Vistara focus on specific server architectures, Panmnesia’s innovation centers on a scalable, off-the-shelf CXL controller and switch.

    Panmnesia argues that the perceived bottleneck in early CXL implementations was not the protocol itself but architectural limitations. Their solution introduces a fabric switch with Port-Based Routing (PBR), which eliminates the restrictive tree topology of earlier designs. This innovation allows memory systems to scale up to 64 compute nodes without major performance degradation, giving hyperscalers the flexibility they need to rationalize expensive DRAM resources.

    With their ongoing development of PCIe 7.0/CXL 4.0 Combo IP, Panmnesia is positioning itself at the forefront of next-generation interconnects, showing that future memory systems will be defined by scalable fabric rather than physical constraints.