Skip to main content

Intel’s new ‘neural network on a stick’ aims to unchain A.I. from the internet

Image used with permission by copyright holder

Intel pulled the curtain back on something pretty awesome. The device, called the Neural Compute Stick 2, is essentially a trainable artificial intelligence that lives on a thumb drive. Despite its small form factor, it has some big implications for the future of computing.

Recommended Videos

Just a few short years ago, neural networks required a lot of computing power to run — so much, in fact, that most of the computation couldn’t actually take place on your smartphone or PC. Instead, the task had to be sent to the cloud, where powerful servers could do the heavy lifting and then send the answer back to your device. In many cases, this is still how a lot of computation-heavy A.I. applications work. Take an Amazon Echo, for example. The little puck on your countertop doesn’t have the brains required to process natural language, understand the nature of your query, and spit out an answer within just a few seconds. So instead of spending multiple hours processing your question locally, it taps into the cloud to access more powerful servers, which perform the task quickly, then sends back the result to your speaker.

Intel’s Neural Compute Stick 2 doesn’t work like this. Thanks to some amazing hardware, the NCS2’s neural network is completely self-contained and doesn’t need any outside help to function. This essentially means that it can operate with far less latency since it doesn’t need to ping a remote server and wait to receive an answer. Everything happens locally, so no information needs to leave the device and travel through the internet.

Image used with permission by copyright holder

Pretty cool, right? But as you’ve probably guessed, the NCS2 isn’t really something that regular folks are likely going to use. It’s aimed squarely at developers looking to create novel applications for computer vision A.I. — but that doesn’t necessarily mean we won’t benefit from it. At its core, the NCS2 is a tool, and Intel is hoping that by making this tool available for just $100, it will quicken the pace at which useful computer vision applications are developed and brought into the world.

So what does this mean for us non-developer folk? It’s hard to say right now — but the possibilities are wide open. Imagine a smart doorbell that can recognize the faces of everyone who lives in your house, tell when the delivery lady drops off a package, or begin recording only when somebody suspicious shows up — all without sending a single bit of information to the cloud. Such a device could offer all the same benefits that existing “smart” doorbells offer, but without compromising your privacy by sharing your data. It also wouldn’t necessarily need an internet connection to, say, unlock your door when it sees you approaching the house.

That’s just one possible use. Intel actually pre-released the NCS2 to a small handful of developers before the wide release, and the things they built with it are nothing short of amazing. One project scans your skin for signs of melanoma. Another puts machine vision into a microscope to spot illness-causing bacteria in drinking water. There’s even one that translates American Sign Language into text instantaneously. The possibilities are truly endless.

And the best part? There aren’t any restrictions on who can buy one of these suckers. If you have $100 and a computer that runs Linux, you can get your hands on an NCS2 and start building stuff. 

Drew Prindle
Former Senior Editor, Features
Drew Prindle is an award-winning writer, editor, and storyteller who currently serves as Senior Features Editor for Digital…
Analog A.I.? It sounds crazy, but it might be the future
brain with computer text scrolling artificial intelligence

Forget digital. The future of A.I. is … analog? At least, that’s the assertion of Mythic, an A.I. chip company that, in its own words, is taking “a leap forward in performance in power” by going back in time. Sort of.

Before ENIAC, the world’s first room-sized programmable, electronic, general-purpose digital computer, buzzed to life in 1945, arguably all computers were analog -- and had been for as long as computers have been around.

Read more
New Intel Core i9-12900KS beats AMD’s best by almost 30%
Intel Caore i9-12900KS processor in a box.

Intel's upcoming latest and greatest, the Core i9-12900KS, is still unreleased -- but a lucky user already received their chip and benchmarked it.

A comparison of the CPU to other high-end chips shows that Intel's new processor may be the best CPU on the market upon release, beating AMD's Ryzen 9 5950X by up to 30%.

Read more
A mysterious new Intel i7 chip just showed up in tests
Intel Alder Lake mobility chip.

A mysterious new Intel Core i7-12650HX processor just showed up in a benchmark, further confirming the existence of the CPU. Intel has yet to reveal the processor or mention it at all, but based on benchmarks, the reveal of the HX-series is likely going to happen.

Thanks to the benchmark, we know more about the specifications of this new Intel Alder Lake offering.

Read more