IBM and Nvidia make deep learning easy for AI service creators with a new bundle

deep learning
Daniel Kaesler/123RF
On Monday, IBM announced that it collaborated with Nvidia to provide a complete package for customers wanting to jump right into the deep learning market without all the hassles of determining and setting up the perfect combination of hardware and software. The company also revealed that a cloud-based model is available as well that eliminates the need to install local hardware and software.

To trace this project, we have to jump back to September when IBM launched a new series of “OpenPower” servers that rely on the company’s Power8 processor. The launch was notable because this chip features integrated NVLink technology, a proprietary communications link created by Nvidia that directly connects the central processor to a Nvidia-based graphics processor, namely the Tesla P100 in this case. Server-focused x86 processors provided by Intel and AMD don’t have this type of integrated connectivity between the CPU and GPU.

According to IBM, the data thrashed between an IBM-based NVLink-embedded CPU and a Nvdia-based GPU moves 2.5 times faster than the movement of data between an AMD/Intel processor and a graphics chip using a PCI Express connection. More specifically, the NVLink communication can shove data at 80GB per second while x86 servers relying on PCI Express only moves data at 32GB per second.

The server IBM is supplying in its new bundle is the Power S822LC designed for high performance computing, which is the foundation for deep learning, machine learning, and artificial intelligence services. This is a 2U rack-mounted server, which can measure up to 3.5 inches in height. This unit consists of two eight-core or ten-core Power8 processors, up to 1TB of system memory, and up to four Tesla P100 graphics chips.

In a pre-release phone call with IBM, the company indicated that one Power8 CPU in the server is assigned two P100 GPUs. There are two NVLink lanes between a single CPU and a single GPU, and two NVLink lanes between the paired GPUs. Thus, the two connected GPUs have an incredibly fast access to large data sets residing in the system memory due to the NVLink connections, and the 115GB-per-second link between the CPU and the system memory. Additionally, the link between both sets of the CPU/GPU trio provides speeds of 38.4GB per second.

Outside the hardware, IBM’s new bundle consists of a deep learning software toolkit called PowerAI. This combines pre-compiled deep learning frameworks (Caffe, Torch, Theano, and OpenBLAS) into one package aimed at Ubuntu 16.04 running on an IBM Power processor, Nvidia CUDA v8.0, and Nvidia cuDNN 5.1.

That’s a lot of server talk we know, so just rest assured that IBM has provided a hardware/software solution that can be used to quickly set up a scalable platform for creating AI-reliant services.

“The new solution supports emerging computing methods of artificial intelligence, particularly deep learning,” the company stated on Monday. “IBM PowerAI also provides a continued path for Watson, IBM’s cognitive solutions platform, to extend its artificial intelligence expertise in the enterprise by using several deep learning methods to train Watson.”

In the pre-announcement briefing, IBM stressed that the PowerAI toolkit will make setting up a platform for AI quick and easy. The bundle of deep learning software is optimized and tested on IBM’s hardware for “ease of implementation.” The company also provides documents via IBM OpenPower to make the installation process a breeze, and promises to continue optimizing the software for future Power-based hardware.

But what does all of this mean for the general consumer? IBM is setting service developers up for a more personal experience. For instance, the hardware/software bundle will likely be used to create an intelligent system for detecting retail bank fraud. This service would compare the face provided in physical IDs that are used across multiple bank branches against the face of the actual customer standing in front of the counter.

Another scenario would be chat bots and call center automation. In both situations, artificial intelligence backed by IBM’s new bundle would quickly understand speech and language, and then answer questions in a more human-like manner. Services would also benefit from a smarter search system thanks to deep learning powered by the hardware/software combo.

“PowerAI democratizes deep learning and other advanced analytic technologies by giving enterprise data scientists and research scientists alike an easy-to-deploy platform to rapidly advance their journey on AI,” said Ken King, General Manager, OpenPower. “Coupled with our high-performance computing servers built for AI, IBM provides what we believe is the best platform for enterprises building AI-based software, whether it’s chatbots for customer engagement, or real-time analysis of social media data.”

Finally, the second component of IBM’s announcement focused on Nimbix, a high performing computing (HPC) cloud platform provider. Nimbix expanded its cloud-based services by installing IBM’s Power S822LC server and the PowerAI suite. Thanks to this offering, customers not wanting to purchase and install the hardware/software combo into a data center can create services that rely on computing in the cloud.

IBM indicated in the briefing that the new Nimbix solution is ideal for high performance computing and deep learning, and won’t require that customers create a virtual machine to provide their services. One of the current compute applications listed on the Nimbix website is machine learning inference demonstration software with a starting price of $5 per hour.

For more information about IBM’s new hardware/software bundle for setting up an AI platform, head here. Nvidia also provides information about deep learning here.

Product Review

If the Surface Studio 2 can't win over Mac fans, nothing can

Most creative professionals are staunchly planted in the Apple camp, but with the Surface Studio 2, Microsoft is making a serious attempt to win them over. Despite its niche appeal, you’ll wish you had a few grand to drop on this beauty.

Make some time for the best smartwatch deals for November 2018

Smartwatches make your life easier by sending alerts right on your wrist. Many also provide fitness-tracking features. So if you're ready to take the plunge into wearables and want to save money, read on for the best smartwatch deals.
Home Theater

From the Roku Ultra to the Fire TV Cube, these are the best streaming devices

There are more options for media streamers than ever, so it’s more difficult to pick the best option. But that’s why we're here. Our curated list of the best streaming devices will get you online in no time.

PlayStation 4 celebrates fifth anniversary with ‘Call of Duty: Black Ops 4’ bundle

The PlayStation 4 is officially five years old today, November 15, and to celebrate the anniversary, Sony is offering a new console bundle that includes a free copy of Call of Duty: Black Ops 4.

Microsoft drops Surface Go price to $350 for Black Friday week

The Microsoft Surface Go convertible tablet has seen a large price drop this Black Friday sales season, lowering the base model to $350 and even the upgraded ones have seen $50 knocked off of their asking price.

The Best Black Friday Deals from Best Buy in 2018

We've been hard at work assembling all the best Black Friday deals Best Buy offers in 2018 and putting them in one place to save you time and money this holiday season. From laptops to TVs, game consoles to smart speakers and much more…

Razer takes up to $500 off of its Blade gaming laptops for Black Friday

If you're a fan of Razer's understated aesthetics that earned the Blade comparisons with Apple's laptops, you can score some big savings on Black Friday, as Razer is offering up to $500 discounts off of its gaming notebooks.

Detangle your desk with a mighty wireless mouse. Here are our six favorites

If you're looking for the best wireless mouse on the market, we've got the list for you!. These six models have something for everyone, whether you're a hardcore gamer or simply looking to ward off carpal tunnel.

Reluctant to give your email address away? Here's how to make a disposable one

Want to sign up for a service without the risk of flooding your inbox with copious amounts of spam and unwanted email? You might want to consider using disposable email addresses via one of these handy services.
Buying Guides

Solid-state drives are speedier than hard disk drives. Are they worth it?

As the price of solid-state drives comes down, it's reached a point where it's hard to recommend a system without at least a hybrid solution. In the battle of SSD vs. HDD, a clear winner has emerged.

Service restored after glitch locks out Microsoft Office 365 business users

Microsoft reported that a problem with its system caused some users to be locked out of their accounts. Because the multifactor authentication system went down globally, some Office 365 and Azure users were unable to log in.

Need a free alternative to Adobe Illustrator? Here are our favorites

Photoshop and other commercial tools can be expensive, but drawing software doesn't need to be. This list of the best free drawing software is just as powerful as some of the more expensive offerings.

The best Walmart Black Friday deals in 2018

Walmart has historically been the undisputed king of Black Friday deals. The mega-store is known for offering deals on products in almost every category, from smart TVs to children’s toys. We're combing through every deal as it is…

Want to game on your Chromebook? Here's where to start

Chromebooks aren't great for gaming, but there are a few titles that most machines can run. There's a surprisingly diverse crowd that includes role-playing games, action side-scrollers, and puzzlers.