– Last updated on: October 17, 2019 –
With the upcoming industry transition to DDR5 server dual-inline memory modules (DIMM), there are a number of key performance and power gains on the horizon, as well as new design challenges. Server system architects and designers want to know what’s new in DDR5 and how can they get the most from this new generation of memory.
In this article:
What changes in DDR5 vs. DDR4?
The top six most significant specification advances made in the transition from DDR4 to DDR5 DIMMs are shown in Table 1 below.
1. DDR5 Scales to 6,400 MT/s
You can never have enough memory bandwidth, and DDR5 helps feed that insatiable need for speed. While DDR4 DIMMs top out at 3,200 megatransfers per second (MT/s) at a clock rate of 1.6 gigahertz (GHz), that’s where DDR5 will start. With initial designs likely at 4,800 MT/s, DDR5 can scale further to double the data rate of DDR4 reaching 6400 MT/s.
2. Lower Voltage Means Lower Power
A second major change is a reduction in operating voltage (VDD), and that will translate to lower power. With DDR5, the DRAM and buffer chip registering clock driver (RCD) voltage drops from 1.2 V down to 1.1 V. However, lower VDD means smaller margin for noise immunity which designers will have to be cognizant of for their implementations.
3. New Power Architecture for DDR5
A third change, and a major one, is power architecture. With DDR5 DIMMs, power management moves from the motherboard to the DIMM itself. DDR5 DIMMs will have a 12-V power management IC (PMIC) on DIMM allowing for better granularity of system power loading. The PMIC distributes the 1.1 V VDD supply, helping with signal integrity and noise with better on-DIMM control of the power supply.
4. DDR5’s New Channel Architecture
Another major change with DDR5, number four on our list, is a new DIMM channel architecture. DDR4 DIMMs have a 72-bit bus, comprised of 64 data bits plus eight ECC bits. With DDR5, each DIMM will have two channels. Each of these channels will be 40-bits wide: 32 data bits with eight ECC bits. While the data width is the same (64-bits total) having two smaller independent channels improves memory access efficiency. So not only do you get the benefit of the speed bump with DDR5, the benefit of that higher MT/s is amplified by greater efficiency.
In the DDR5 DIMM architecture, the left and right side of the DIMM, each served by an independent 40-bit wide channel, share the RCD. In DDR4, the RCD provides two output clocks per side. In DDR5, the RCD provides four output clocks per side. The 32-bit data of each 40-bit channel consist of four 8-bit lanes, and each of these lanes gets an independent clock signal from the RCD. Giving each lane an independent clock improves signal integrity, helping to address the lower noise margin issue raised by lowering the VDD (from change #2 above).
5. Longer Burst Length
The fifth major change is burst length. DDR4 burst chop length is four and burst length is eight. For DDR5, burst chop and burst length will be extended to eight and sixteen to increase burst payload. Burst length of sixteen (BL16), allows a single burst to access 64 Bytes of data, which is the typical CPU cache line size. It can do this using only one of the two independent channels. This provides a significant improvement in concurrency and with two channels, greater memory efficiency.
6. DDR5 Supports Higher Capacity DRAM
A sixth and final change to highlight for DDR5 is support for higher-capacity DRAM devices. With DDR5 buffer chip DIMMs, the server or system designer can use densities of up to 32-Gb DRAMs in a single-die package. DDR4 maxes out at 16 Gb DRAM in a single-die package. DDR5 supports features like on-die ECC, error transparency mode, post-package repair, and read and write CRC modes to support higher-capacity DRAMs.
What are the DDR5 Design Challenges?
These changes in DDR5 introduce a number of design considerations dealing with higher speeds and lower voltages – raising a new round of signal integrity challenges. Designers will need to ensure that motherboards and DIMMs can handle the higher signal speeds. When performing system-level simulations, signal integrity at all DRAM locations need to be checked.
For DDR4 designs, the primary signal integrity challenges were on the dual-data-rate DQ bus, with less attention paid to the lower-speed command address (CA) bus. For DDR5 designs, even the CA bus will require special attention for signal integrity. In DDR4, there was consideration for using differential feedback equalization (DFE) to improve the DQ data channel. But for DDR5, the RCD’s CA bus receivers will also require DFE options to ensure good signal reception.
The power delivery network (PDN) on the motherboard is another consideration, including up to the DIMM with the PMIC. Considering the higher clock and data rates, you will want to make sure that the PDN can handle the load of running at higher speed, with good signal integrity, and with good clean power supplies to the DIMMs.
The DIMM connectors from the motherboard to the DIMM will also have to handle the new clock and data rates. For the system designer, at the higher clock speeds and data rates around the printed circuit board (PCB), more emphasis must be placed on system design for electromagnetic interference and compatibility (EMI and EMC).
How do DDR5 memory interface chipsets harness the advantages of DDR5 for DIMMs?
The good news is that DDR5 memory interface chips improve signal integrity for the command and address signals sent from the host memory controller to the DIMMs. The bus for each of the two channels goes to the RCD and then fans out to the two halves of the DIMM. The RCD effectively reduces the loading on the CA bus that the host memory controller sees.
DDR5 data buffer chips will reduce the effective load on the data bus, enabling the higher-capacity DRAMs on the DIMM without degrading latency.
Rambus offers a DDR5 memory interface chipset that helps designers harness the full advantages of DDR5 while dealing with the signal integrity challenges of higher data, CA and clock speeds.
As a renowned leader in signal integrity (SI) and power integrity (PI), Rambus has a 30 year of history in enabling the highest performance systems in the market.
Leave a Reply