Skip to main content

Facebook's Mark Zuckerberg pulls back the veil on the Jarvis AI system he created

1143461 autosave v1 2 mark zuckerberg ceo at facebook
Image used with permission by copyright holder
In a lengthy post published to his nearly 13-year-old pet project, Facebook, social network wunderkind Mark Zuckerberg has officially unveiled the ins and outs of his built-from-scratch home artificial intelligence system. Dubbed Jarvis — a nod to the AI system Tony Stark employs in Marvel’s Iron Man comics — Zuckerberg designed his personalized home automation network to make accomplishing such tasks as playing music or dimming the lights easy while also allowing the AI to personally learn his “tastes and patterns.” Though he’d personally given updates (and even run public tests) on the system in the past, his recent briefing serves as the project’s most in-depth explainer.

Built using Objective C, PHP, and Python, the Jarvis AI system is essentially an ubertalented version of Amazon’s Alexa or Google’s Home device. Capable of operating a number of smart products in Zuckerberg’s home — such as his Crestron lighting system, his Sonos and Spotify setup, and the Nest cam he uses to check in on his daughter — Zuckerberg acknowledged that one of the hardest parts of the entire process was figuring out a way for each smart home system to communicate effectively with each other.

Recommended Videos

“Before I could build any AI, I first needed to write code to connect these systems, which all speak different languages and protocols,” Zuckerberg wrote. “We use a Crestron system with our lights, thermostat and doors; a Sonos system with Spotify for music; a Samsung TV; a Nest cam for Max; and, of course, my work is connected to Facebook’s systems. I had to reverse engineer APIs for some of these to even get to the point where I could issue a command from my computer to turn the lights on or get a song to play.”

Zuckerberg talking about his Jarvis AI system in Italy over the summer. Facebook

After overcoming this initial hurdle, Zuckerberg turned his attention to allowing Jarvis to heed and interpret communication as similarly as possible to that of a human. To accomplish this, the system had to have a method for receiving text messages while maintaining the ability to translate actual speech. Zuckerberg felt the text message and speech combination was an incredibly important decision, admitting he’s surprised at how much more he texts Jarvis instead of talking to it.

Please enable Javascript to view this content

“One thing that surprised me about my communication with Jarvis is that when I have the choice of either speaking or texting, I text much more than I would have expected,” he continued. “This is for a number of reasons, but mostly it feels less disturbing to people around me. If I’m doing something that relates to them, like playing music for all of us, then speaking feels fine, but most of the time text feels more appropriate.”

What may be most impressive about Jarvis’ ability to receive texts is the fact Zuckerberg built a dedicated Messenger bot that allows him to chat with the system no matter where he’s actually located. Not only does this allow him to preemptively turn on his lights but it also provides a supremely effective way to keep up with what’s going on at his house. For instance, with the inclusion of an advanced facial- and speech-recognition feature, Jarvis keeps Zuckerberg in the loop should someone stroll up to his house — known or unknown. Furthermore, if the system recognizes the person, it automatically lets them in — after taking their photo and adding it to the Messenger conversation, of course.

Though the system isn’t perfect — during an exclusive Fast Company demo, it took Zuckerberg four tries to turn off his lights — he says he’s committed to staying focused on continuously improving Jarvis since he uses it every day. Be it the addition of more voice terminals or the creation of an Android app (currently, Zuckerberg uses an iPhone to control Jarvis), there’s still plenty to be accomplished. However, from the looks of the schematic Zuckerberg published, it appears as though his system is essentially perfect. How so? Because he’s programmed Jarvis to be compatible with a T-shirt cannon that fires a new gray tee to Zuckerberg when he asks for one. If you ask us, that’s peak artificial intelligence.

Rick Stella
Former Digital Trends Contributor
Rick became enamored with technology the moment his parents got him an original NES for Christmas in 1991. And as they say…
Everything you need to know before buying a space heater
A Vornado heater on a table.

Space heaters are a simple (and affordable way) to keep your home warm during the chilly winter months. Offered in a variety of sizes, you'll find models designed for small offices, sprawling living rooms, and everything in between. However, space heaters are also responsible for house fires and other accidents -- meaning you have to be careful with how you use them.

Before rushing out and adding a space heater to your home, here are a few things to consider. From checking available safety features and finding the right size to placing it in your home and avoiding smart plugs, here’s everything you need to know about these useful gadgets.
Check for crucial safety features
The most important feature to look for in a space heater is the tip-over switch. Products with a tip-over switch will automatically turn off when they're knocked over, making it an indispensable safety feature. It’s rare to find products without a tip-over switch nowadays, as all the best space heaters use them.  But if you're shopping for older devices, be sure it has one of these. If it doesn’t, the heater will pose a serious fire hazard if it gets knocked over.

Read more
The 11 best smart home products that support Matter
Amazon Fire TV on Echo Show 15.

Matter is arguably the biggest thing to happen to smart homes since their inception. The interoperability feature lets devices from different ecosystems interact with each other, giving you the freedom to shop for your favorite products regardless of manufacturer. Unfortunately, not all devices have rolled out support for Matter – and not all of them will.

Some notable products support Matter as of today, although dozens more are expected to add the functionality in the coming months. For now, here are the 11 best smart home products that support Matter. For a full list, head over to the official Matter website. We've seen massive adoption of the technology over the past few years, so there's a good chance your favorite devices now support Matter.

Read more
You only need to spend $34 to stay warm with this space heater deal
The Dreo DR-HSH006 space heater in the living room.

If this winter has felt particularly chilly in your house, you might want to take a look at space heater deals. If you want one that's portable and budget-friendly, check out the Dreo DR-HSH006, which is currently on sale from Walmart with a $36 discount that drops its price from $70 to just $34. There's probably not much time remaining before this flash deal expires, so if you're interested in buying this heating device for less than half-price, you need to proceed with the transaction right now.

Why you should buy the Dreo DR-HSH006 space heater
While there are space heaters that are huge and bulky, the Dreo DR-HSH006 is a portable model with a handle that you can carry to different rooms around the house, so you can use it wherever you are. It only takes a few seconds to warm up and provide heat, with temperature settings between 41 and 95 degrees Fahrenheit that you can adjust in increments of 1 degree. Since it's powered by a brushless DC motor and it's equipped with a winglet fan, the device operates silently at just 34dB, so it won't disturb you while it works in the background.

Read more