Skip to main content

The future of fast PC graphics? Connecting directly to SSDs

Performance boosts are expected with each new generation of the best graphics cards, but it seems that Nvidia and IBM have their sights set on greater changes.

The companies teamed up to work on Big accelerator Memory (BaM), a technology that involves connecting graphics cards directly to superfast SSDs. This could result in larger GPU memory capacity and faster bandwidth while limiting the involvement of the CPU.

A chart breaks down Nvidia and IBM's BaM technology.
Image source: Arxiv

This type of technology has already been thought of, and worked on, in the past. Microsoft’s DirectStorage application programming interface (API) works in a somewhat similar way, improving data transfers between the GPU and the SSD. However, this relies on external software, only applies to games, and only works on Windows. Nvidia and IBM researchers are working together on a solution that removes the need for a proprietary API while still connecting GPUs to SSDs.

The method, amusingly referred to as BaM, was described in a paper written by the team that designed it. Connecting a GPU directly to an SSD would provide a performance boost that could prove to be viable, especially for resource-heavy tasks such as machine learning. As such, it would mostly be used in professional high-performance computing (HPC) scenarios.

The technology that is currently available for processing such heavy workloads requires the graphics card to rely on large amounts of special-purpose memory, such as HBM2, or to be provided with efficient access to SSD storage. Considering that datasets are only growing in size, it’s important to optimize the connection between the GPU and storage in order to allow for efficient data transfers. This is where BaM comes in.

“BaM mitigates the I/O traffic amplification by enabling the GPU threads to read or write small amounts of data on-demand, as determined by the compute,” said the researchers in their paper, first cited by The Register. “The goal of BaM is to extend GPU memory capacity and enhance the effective storage access bandwidth while providing high-level abstractions for the GPU threads to easily make on-demand, fine-grain access to massive data structures in the extended memory hierarchy.”

An Nvidia GPU core sits on a table.
Niels Broekhuijsen/Digital Trends

For many people who don’t work directly with this subject, the details may seem complicated, but the gist of it is that Nvidia wants to rely less on the processor and connect directly to the source of the data. This would both make the process more efficient and free up the CPU, making the graphics card much more self-sufficient. The researchers claim that this design would be able to compete with DRAM-based solutions while remaining cheaper to implement.

Although Nvidia and IBM are undoubtedly breaking new ground with their BaM technology, AMD worked in this area first: In 2016, it unveiled the Radeon Pro SSG, a workstation GPU with integrated M.2 SSDs. However, the Radeon Pro SSG was intended to be strictly a graphics solution, and Nvidia is taking it a few steps further, aiming to deal with complex and heavy compute workloads.

The team working on BaM plans to release the details of their software and hardware optimization as open source, allowing others to build on their findings. There is no mention as to when, if ever, BaM might find itself implemented in future Nvidia products.

Editors' Recommendations

Monica J. White
Monica is a UK-based freelance writer and self-proclaimed geek. A firm believer in the "PC building is just like expensive…
Nvidia may launch 3 new GPUs, and they’re bad news for AMD
An Nvidia GeForce RTX graphics card seen from the side.

In a surprising twist, Nvidia might be releasing not one, but three graphics cards. They all fall under the same RTX 4060 umbrella, although two of them are RTX 4060 Ti models.

This marks a strong entry into the midrange segment for Nvidia, with one of the cards addressing a significant concern -- low VRAM. Should AMD be worried about losing even more business to Team Green?

Read more
3 reasons you should still buy an Nvidia GPU over AMD
Nvidia GeForce RTX 4080 lays on a pink surface.

We all love to cheer for the underdog -- a position AMD relishes in the GPU space. That's especially true when Nvidia continues to increase its prices to astronomic new heights. More than that, when going to buy a new graphics card for your system, there are some legitimate reasons to go Team Red.

And yet, there's a reason Nvidia continues to dominate. As much as I hate to admit it, right now, there's no question that Nvidia has the upper hand.
DLSS and Reflex

Read more
The best GPU overclocking software in 2023
A GPU with a fan.

The best GPU overclocking software in 2023 is the same as it's been for the past decade: MSI Afterburner. It's an awesome tool for pushing your graphics card to its extremes, whether you're trying to eke out a little more power from your RX 6500 XT, or push your RTX 4090 beyond its already ridiculous performance.

That's not the only graphics card overclocking tool worth considering though. AMD and Nvidia's first-party apps have been getting better and better, and there are some other manufacturer-specific GPU overclocking tools worth considering.

Read more