New DRAM for next-generation AI GPUs

2025 June 12. 06:56   

NVIDIA has commissioned Samsung Electronics, SK hynix, and Micron to develop SoCEM. This is a new memory module standard invented by NVIDIA, and Micron is reportedly the first to receive a license for mass production. This puts the American memory manufacturer ahead of its South Korean rivals.

According to South Korean media reports, the new SoCEM standard is a memory module invented by NVIDIA that consists of 16 stacked LPDDR5X chips arranged in groups of four.

SoCEM is a new DRAM that connects to the CPU and its primary task is to ensure peak performance for AI accelerators. SoCEM is expected to appear in NVIDIA's next-generation AI GPUs, Rubin, which will be released in 2026.

Unlike HBM (a DRAM connected to the GPU), which connects DRAM using vertical drilling, SoCEM is manufactured using a wire bonding method that connects 16 chips with copper wires. Copper has high thermal conductivity, and its main advantage is that it minimizes the heat generation of individual DRAM chips. According to Micron, the energy efficiency of its latest low-power DRAM is 20% higher than that of its competitors.

NVIDIA's next-generation AI server (with Rubin AI GPUs and Vera CPUs) will use 4 x SoCEM memory modules, which translates to a total of 256 chips based on the number of LPDDR5X memory modules. According to the industry, Micron was able to ship SoCEM memory modules earlier than SK hynix or Samsung due to the introduction of later EUV lithography equipment, the new report states.

This means that, unlike its DRAM manufacturing competitors, which are using EUV to increase DRAM performance, US-based Micron has used low-heat technology while improving memory performance.

SoCEM is not the only example of Micron's advanced technological capabilities. Micron reportedly supplied most of the initial low-power DRAM for this year's Galaxy S25 series, ahead of Samsung Semiconductor. This made Micron the "main memory supplier" for Samsung smartphones for the first time. Micron also developed the world's first LPDDR5X in 2022, which was installed in the iPhone 15 series. 

Share this post
After a Historic Turn, SK Hynix Becomes the New Market Leader in the Memory Industry
2025. August 17.

After a Historic Turn, SK Hynix Becomes the New Market Leader in the Memory Industry

 For three decades, the name Samsung was almost synonymous with leadership in the DRAM market. Now, however, the tables have turned: in the first half of 2025, South Korea’s SK Hynix surpassed its rival in the global memory industry for the first time, ending a streak of more than thirty years. This change signifies not just a shift in corporate rankings but also points to a deeper transformation across the entire semiconductor industry.
The Most Popular Theories About the Impact of AI on the Workplace
2025. August 07.

The Most Popular Theories About the Impact of AI on the Workplace

 Since the release of ChatGPT at the end of 2022, the field of AI has seen impressive developments almost every month, sparking widespread speculation about how it will change our lives. One of the central questions concerns its impact on the workplace. As fears surrounding this issue persist, I believe it's worth revisiting the topic from time to time. Although the development of AI is dramatic, over time we may gain a clearer understanding of such questions, as empirical evidence continues to accumulate and more theories emerge attempting to answer them. In this article, I’ve tried to compile the most relevant theories—without claiming to be exhaustive—as the literature on this topic is expanding by the day. The question remains: can we already see the light at the end of the tunnel, or are we still heading into an unfamiliar world we know too little about?
Neuralink’s Rivals Are Already in the Clinic – Europe’s Answer to Musk’s Brain Chips
2025. August 04.

Neuralink’s Rivals Are Already in the Clinic – Europe’s Answer to Musk’s Brain Chips

 While Silicon Valley is loud with the hype surrounding brain-computer interfaces (BCIs), attention often centers on one high-profile name: Elon Musk’s Neuralink. Behind the scenes, however, Europe is quietly yet determinedly building its own neurotechnological future. Startups across the continent are not merely following trends—they are shaping the market with unique solutions, often rooted in practical medicine and materials science. This raises the question: in the shadow of flashy American marketing, can Europe’s quieter innovation achieve real breakthroughs and take a leading role in this revolutionary field?
NVIDIA Driver Support Changes – The Clock Is Ticking for the GTX 900–10 Series
2025. August 01.

NVIDIA Driver Support Changes – The Clock Is Ticking for the GTX 900–10 Series

 NVIDIA has announced a major shift in its driver support strategy. This decision affects millions of users, but what does it actually mean in practice? Is it really time for everyone to consider upgrading their hardware, or is the situation more nuanced? Understanding the implications is key to staying prepared for the technological changes of the coming years.
This Is What the Google Pixel 10 Might Look Like — But Do We Really Know Everything Yet?
2025. August 01.

This Is What the Google Pixel 10 Might Look Like — But Do We Really Know Everything Yet?

 The Google Pixel series, known for its clean software and outstanding photography capabilities, is reaching its 10th generation this year. Ahead of the official launch, expected on August 20, a wealth of information and rumors is already circulating online, outlining a device family that may not bring dramatic visual changes but instead introduces real, tangible innovations under the hood. But are these improvements enough for the Pixel 10 to stand out in an increasingly crowded market?
A Brutal Quarter for Apple, but What Comes After the iPhone?
2025. August 01.

A Brutal Quarter for Apple, but What Comes After the iPhone?

 Amid global economic and trade challenges, Apple has once again proven its extraordinary market power, surpassing analyst expectations in the third quarter of its 2025 fiscal year. The Cupertino giant not only posted record revenue for the period ending in June but also reached a historic milestone: the shipment of its three billionth iPhone. This achievement comes at a time when the company is grappling with the cost of punitive tariffs, intensifying competition in artificial intelligence, and a series of setbacks in the same field.

Linux distributions

Desktop Environments

Popular