Microsoft’s head of research opens up about Google X, Windows 9, and the future

Peter Lee Microsoft Research

“I’m not ready to talk about Special Projects,” Peter Lee, head of Microsoft Research, told me on Monday – before he proceeded to tell me all about Special Projects.

Microsoft Research has 1,100 computer scientists, researchers, and engineers in labs all around the world. Add in 1,200 PhD student interns every year, and Microsoft’s R&D department is on the same scale as a good-sized research university. It’s responsible for some remarkable stuff – Cortana, the tech behind Kinect, and so on – yet you almost never hear from the group directly.

The international press has written tens of thousands of articles about Google X, the company’s blue-sky, moon-shot research arm that’s dabbling in anything and everything from self-driving cars to robot moon landers to a cure for death itself, but Microsoft’s own crazy projects haven’t gotten nearly the coverage.

“I like Google X. The people there are good friends of mine.”

Microsoft Research finally earned some long-overdue headlines last week, when ZDNet’s Mary Jo Foley reported on a “Special Projects” group that would tackle disruptive technology and ultimately Google X. But Lee said he’s not frustrated by all of that glowing press Google’s research guys have garnered.

“Frustrating is not quite the right word,” Lee told Digital Trends, in an interview ahead of the ribbon-cutting ceremony for MSR’s New York City office. “I like Google X. The people there are good friends of mine. Astro [Teller, “Captain of Moonshots” with Google X] took classes from me at Carnegie Mellon, he’s a great guy doing great stuff. But the missions are different. We want to make things better and ship them. That will always be primary for us. It will be secondary for them.”

Lee is a corporate vice president at Microsoft, formerly a key department head at DARPA and the guy in charge of Carnegie Mellon’s computer science department before that. He’s also as affable and charming as you could imagine, as well as unexpectedly amusing for a researcher who writes dense technical treatises with names like “Optimizing ML with Run-Time Code Generation” and “Metacircularity in the polymorphic lambda calculus.” (Published in a 1991 issue of Theoretical Computer Science – look it up.)

Microsoft Research vs. Google X

Microsoft Research’s work spans four quadrants, Lee said: One is mission-focused, work requested by other departments for example. A second field is sustaining technologies, improving testing tools for example, or machine translation ability. Then there are disruptive technologies and ultimately that moon-shot stuff.

Microsoft lab quadrant graph“Special projects is really directed at this upper quadrant,” Lee said, pointing to the disruptive quadrant of his grid, which he defined as what’s new and surprising and inventive, rather than the blue-sky, open-ended, curiosity-driven work that pushes the frontiers. “Stay tuned, it’s a cool development for us.”

One directive of new CEO Satya Nadella is for the group to finally put step into the spotlight, something Lee said was a great development.

“I would prefer that the world not have too much envy for Google X.”

“I would prefer that the world not have too much envy for Google X,” he told Digital Trends.

“It’s a good thing for the industry, and it’s a good thing for all of us — to expand what people imagine is possible with technology. That’s something we want to do, and it’s something Google X wants to do. And at the same time we want to do real things that reach real people now, rather than later.”

The Special Projects group will be headed up by Norman A. Whitaker, Microsoft announced last week. Whitaker is former deputy director of the Information Innovation Office at DARPA, where he worked together with Lee way back when.

“DARPA and Microsoft Research are similar in that there is a specific focus in looking beyond the headlights to the next big thing,” explained Lee.

Cortana and machine learning

A big chunk of Microsoft Research is aimed at that blue-sky foundational research, Lee said, not concerned with business imperatives and just looking for the next big thing. Other groups work with specific mandates, tasked by senior management to help different business units with something specific.

That’s where Cortana came from.

Microsoft lab opening 2
Microsoft Research’s new NYC lab

Steve Ballmer himself tasked the team with developing a smart voice-recognition system for the Windows Phone platform, although most such collaborative work isn’t tasked from above. In a few areas there is some high-level company directive, he acknowledged. The research staff in Redmond build a feature called Interactive Classifier into Cortana, which allows a small team of non-expert engineers to do continuous evolution of the system.

“With a very few number of parameters, just a few dozen, you get a continuous improvement,” Lee said. “That’s why it’s in beta. As it gets used, every day Cortana is getting a little bit more human in its responses.”

Windows 9

Another rare, top-down command might shape the next iteration of Windows, which is likely to be called Windows 9 – although Lee declined to even confirm the existence of an update to the OS. New CEO Satya Nadella has made clear his vision of a cloud-enabled Windows. He even stressed it in his first letter to the to the company.

Yet Windows at present doesn’t rely on the cloud for computing power. Sure, there’s OneDrive, a great place to store stuff, and the Office family of apps can be run from the cloud. But unlike other Microsoft products, that’s where the integration ends.

Bing, by contrast, lives and breathes because of the hidden, back-end power of the cloud, as does Siri – and by extension, some of the neatest features of the Windows Phone platform (Android too, of course). But the desktop? Not so much.

That’ll change in Windows 9, if Microsoft Research has anything to say about it.

“One of the mission-focused activities [those dictated by other divisions within the company] is centered around something called the Enterprise Graph. It sounds really boring but for us it’s really interesting,” he said.

Presently, Windows doesn’t rely on the cloud for computing power … That’ll change in Windows 9.

Microsoft has a lot of customers that are big companies with hundreds of thousands of employees. Your smartphone may realize you take the same route to work everyday, thanks to data stored and analyzed in the loud, but Windows apps and the OS itself just don’t get it.

“Using machine learning to extract relationships, entities, key ideas being worked on and bring those to the surface in tools. Maybe even digital-assistant tools to make companies more productive and smarter. That’s one area we’re going at” for Windows 9, Lee said.

If that sounds familiar, it should: It’s how Bing processes and parses pieces of information to understand that your search for “Adam Levine news” is really for gossip about the Maroon 5 guy – and surfaces news that lets you tell your friends “dude, did you hear, he just dyed his hair!” Doing it for computers is different than doing it for the world wide web, Lee said.

“Bing tries to understand entities. When someone does a Bing search for ‘Canon 4D’ and they click the Canon Rebel link, we learn about those relationships. With enterprise there’s similar issues but with much less data. The computer science ends up being different.”

“If I write a document and I want to say, share this with the appropriate people that work with Vikram from the meeting, or say, ‘what’s trending around me at work,’ not in my personal space but at work … answering questions like that requires a very different kind of machine learning,” he said.

Beyond the algorithm

It’s not all work for Lee. To describe artificial intelligence in action, he cited the AI powering the grunts in the videogame Titanfall.

“It’s been about a week since I last played,” he acknowledged. Ostensibly, it’s an excuse to appreciate how the AI gets smarter over time. But come on. It’s Titanfall.

And besides, there’s more to Microsoft Research than just building a better algorithm or building a better phone. Lee really believes that machine learning and smarter computers could shape society, and bring us to a deeper understanding of what makes us all tick.

“We’re on the cusp of understanding something really important about human nature. It sounds pretentious but that’s a real thing for us.”

“Research is a long game.”

Emerging Tech

Microsoft’s friendly new A.I wants to figure out what you want — before you ask

Move over Siri and Alexa! Microsoft wants to build a new type of virtual assistant that wants to be your friend. Already making waves in Asia, could this be the future of A.I. BFFs?
Emerging Tech

Forget joysticks — the Guts Game is controlled by a sensor that you swallow

Researchers have created an unusual new game in which players swallow a biosensor and then compete to raise or lower the temperature in their gut. Sound crazy? Here's why it could catch on.
Emerging Tech

Stronger than steel, thinner than paper, graphene could be the future of tech

Since its discovery, graphene has set the research world on fire. What exactly is it, though, and what could it mean for the future of tech? Here's everything you need to know about what could be the next supermaterial to take center stage.

Hacker finds Steam bug that unlocks free games, collects $20K for reporting it

Security researcher Artem Moskowsky discovered a Steam bug that allowed him to generate infinite free keys for any game. Instead of abusing the exploit, Moskowsky reported it to Valve, which gave him a $20,000 reward.

Infiniti is using Formula One racing to hone its hybrid skills

Infiniti is partnering with the Renault Sport Formula One team, and not just to put sponsor stickers on the race cars. The luxury brand claims its engineers are working with their F1 counterparts to develop future hybrid tech.

Blizzard Co-Founder Allen Adham says ‘we have not forgotten’ core Diablo fans

Blizzard fans are skeptical of 'Diablo Immortal,' but company co-founder Allen Adham is confident players will like it when they play it. He told us that multiple Diablo projects are underway and hinted at end-game content in 'Diablo…

Privacy is becoming obsolete, but not everyone thinks you should fear its demise

As technologies like Alexa and Siri that require more information about us continue to develop, is privacy going to fall at the wayside, or can we take back control of our data to retain our privacy?
Emerging Tech

To make more room for livestock, the Dutch will moove cows to a floating farm

A Dutch company is developing a floating dairy farm, which they hope to use as a proof-of-concept for future agricultural systems. The farm will use automated cleaning and milking robots, while recycling waste into fertilizer.
Emerging Tech

Driverless cars can only take you so far. This is how smarter cities are being built

Companies and municipalities came together at the annual Smart Mobility Summit, to share new technologies for building smarter cities. They also offered insight into the challenge cities face.

As Amazon turns up the volume on streaming, Spotify should shudder

Multiple players are all looking to capitalize on the popularity of streaming, but it has thus far proved nearly impossible to make a profit. Could major tech companies like Amazon be primed for a streaming take-over?
Movies & TV

‘What We Do In The Shadows’ turns Jemaine Clement into a creature of the night

With a career as unique as the man himself, Jemaine Clement’s star is still rising. From his HBO show (and band) Flight of the Conchords to his TV spinoff of What We Do in the Shadows, we dig deep into the funnyman’s many roles.

The history of Battle Royale: From mod to worldwide phenomenon

Battle royale games like PlayerUnknown's Battlegrounds’ and Fortnite have become the biggest trend in video games. The genre is also pushing the envelope in streaming and eSports in a way that might hint at the future of the industry.
Emerging Tech

Michigan’s former transportation chief has some advice for wannabe smart cities

After 31 years as Michigan’s transportation director, Kirk Steudle has seen it all, particularly with smart city projects. He spoke with Digital Trends recently about what makes smart cities work, and offers advice along the way.
Health & Fitness

JLABS injects some tech into the medical industry

Innovating health care is expensive, risky, and complicated legally. One company is trying to remove these barriers with clever and altruistic approach.