SK hynix Starts Production of 192 GB SOCAMM2 Memory Module for NVIDIA AI Platforms

SK hynix starts mass production of the 192 GB SOCAMM2 memory module, designed for NVIDIA AI platforms.

SK hynix Starts Production of 192 GB SOCAMM2 Memory Module for NVIDIA AI Platforms
192 GB SOCAMM2 memory module from SK hynix

SK hynix has announced the start of mass production of the 192 GB SOCAMM2 memory module, a next-generation memory module based on low-power LPDDR5X technology, designed specifically for NVIDIA AI platforms, in particular the Vera Rubin architecture.

Key features of the 192 GB SOCAMM2

The SOCAMM2 represents a significant evolution in server memory, adapting low-power memory traditionally used in mobile devices such as smartphones to server environments. This module is designed to serve as the primary memory solution for next-generation AI servers.

Its standout features include:

  • Capacity and performance: With a capacity of 192 GB, the SOCAMM2 offers more than double the bandwidth of traditional RDIMM modules, while improving energy efficiency by over 75%.
  • Compatibility with NVIDIA Vera Rubin: The module is designed to integrate seamlessly with NVIDIA's Vera Rubin platform, optimizing performance for advanced AI applications.
  • Modular design: Using a compression connector, the SOCAMM2 makes installation and maintenance simpler, while maintaining high performance and reducing power consumption.

Implications for the AI industry

The introduction of the 192 GB SOCAMM2 has significant implications for the artificial intelligence industry. As AI models grow in size and demand for high memory capacity increases, this module offers an effective solution to address memory bottlenecks during the training and inference of large language models, significantly improving overall system performance.

Furthermore, the collaboration between SK hynix and NVIDIA in designing this module highlights the importance of strategic alliances in meeting emerging needs in the AI sector, ensuring memory solutions that effectively support advanced AI applications.

Future outlook

With the start of mass production of the 192 GB SOCAMM2, SK hynix positions itself as a leader in supplying advanced memory solutions for AI servers. The company plans to further expand its offering, with plans for modules with higher capacities, thus responding to the growing demands of the AI market.

In conclusion, the introduction of the 192 GB SOCAMM2 represents a significant step in the evolution of memory solutions for AI servers, offering superior performance and energy efficiency, and consolidating SK hynix's position as a key supplier in the sector.