Microsoft’s head of research opens up about Google X, Windows 9, and the future

Peter Lee Microsoft Research

“I’m not ready to talk about Special Projects,” Peter Lee, head of Microsoft Research, told me on Monday – before he proceeded to tell me all about Special Projects.

Microsoft Research has 1,100 computer scientists, researchers, and engineers in labs all around the world. Add in 1,200 PhD student interns every year, and Microsoft’s R&D department is on the same scale as a good-sized research university. It’s responsible for some remarkable stuff – Cortana, the tech behind Kinect, and so on – yet you almost never hear from the group directly.

The international press has written tens of thousands of articles about Google X, the company’s blue-sky, moon-shot research arm that’s dabbling in anything and everything from self-driving cars to robot moon landers to a cure for death itself, but Microsoft’s own crazy projects haven’t gotten nearly the coverage.

“I like Google X. The people there are good friends of mine.”

Microsoft Research finally earned some long-overdue headlines last week, when ZDNet’s Mary Jo Foley reported on a “Special Projects” group that would tackle disruptive technology and ultimately Google X. But Lee said he’s not frustrated by all of that glowing press Google’s research guys have garnered.

“Frustrating is not quite the right word,” Lee told Digital Trends, in an interview ahead of the ribbon-cutting ceremony for MSR’s New York City office. “I like Google X. The people there are good friends of mine. Astro [Teller, “Captain of Moonshots” with Google X] took classes from me at Carnegie Mellon, he’s a great guy doing great stuff. But the missions are different. We want to make things better and ship them. That will always be primary for us. It will be secondary for them.”

Lee is a corporate vice president at Microsoft, formerly a key department head at DARPA and the guy in charge of Carnegie Mellon’s computer science department before that. He’s also as affable and charming as you could imagine, as well as unexpectedly amusing for a researcher who writes dense technical treatises with names like “Optimizing ML with Run-Time Code Generation” and “Metacircularity in the polymorphic lambda calculus.” (Published in a 1991 issue of Theoretical Computer Science – look it up.)

Microsoft Research vs. Google X

Microsoft Research’s work spans four quadrants, Lee said: One is mission-focused, work requested by other departments for example. A second field is sustaining technologies, improving testing tools for example, or machine translation ability. Then there are disruptive technologies and ultimately that moon-shot stuff.

Microsoft lab quadrant graph“Special projects is really directed at this upper quadrant,” Lee said, pointing to the disruptive quadrant of his grid, which he defined as what’s new and surprising and inventive, rather than the blue-sky, open-ended, curiosity-driven work that pushes the frontiers. “Stay tuned, it’s a cool development for us.”

One directive of new CEO Satya Nadella is for the group to finally put step into the spotlight, something Lee said was a great development.

“I would prefer that the world not have too much envy for Google X.”

“I would prefer that the world not have too much envy for Google X,” he told Digital Trends.

“It’s a good thing for the industry, and it’s a good thing for all of us — to expand what people imagine is possible with technology. That’s something we want to do, and it’s something Google X wants to do. And at the same time we want to do real things that reach real people now, rather than later.”

The Special Projects group will be headed up by Norman A. Whitaker, Microsoft announced last week. Whitaker is former deputy director of the Information Innovation Office at DARPA, where he worked together with Lee way back when.

“DARPA and Microsoft Research are similar in that there is a specific focus in looking beyond the headlights to the next big thing,” explained Lee.

Cortana and machine learning

A big chunk of Microsoft Research is aimed at that blue-sky foundational research, Lee said, not concerned with business imperatives and just looking for the next big thing. Other groups work with specific mandates, tasked by senior management to help different business units with something specific.

That’s where Cortana came from.

Microsoft lab opening 2
Microsoft Research’s new NYC lab

Steve Ballmer himself tasked the team with developing a smart voice-recognition system for the Windows Phone platform, although most such collaborative work isn’t tasked from above. In a few areas there is some high-level company directive, he acknowledged. The research staff in Redmond build a feature called Interactive Classifier into Cortana, which allows a small team of non-expert engineers to do continuous evolution of the system.

“With a very few number of parameters, just a few dozen, you get a continuous improvement,” Lee said. “That’s why it’s in beta. As it gets used, every day Cortana is getting a little bit more human in its responses.”

Windows 9

Another rare, top-down command might shape the next iteration of Windows, which is likely to be called Windows 9 – although Lee declined to even confirm the existence of an update to the OS. New CEO Satya Nadella has made clear his vision of a cloud-enabled Windows. He even stressed it in his first letter to the to the company.

Yet Windows at present doesn’t rely on the cloud for computing power. Sure, there’s OneDrive, a great place to store stuff, and the Office family of apps can be run from the cloud. But unlike other Microsoft products, that’s where the integration ends.

Bing, by contrast, lives and breathes because of the hidden, back-end power of the cloud, as does Siri – and by extension, some of the neatest features of the Windows Phone platform (Android too, of course). But the desktop? Not so much.

That’ll change in Windows 9, if Microsoft Research has anything to say about it.

“One of the mission-focused activities [those dictated by other divisions within the company] is centered around something called the Enterprise Graph. It sounds really boring but for us it’s really interesting,” he said.

Presently, Windows doesn’t rely on the cloud for computing power … That’ll change in Windows 9.

Microsoft has a lot of customers that are big companies with hundreds of thousands of employees. Your smartphone may realize you take the same route to work everyday, thanks to data stored and analyzed in the loud, but Windows apps and the OS itself just don’t get it.

“Using machine learning to extract relationships, entities, key ideas being worked on and bring those to the surface in tools. Maybe even digital-assistant tools to make companies more productive and smarter. That’s one area we’re going at” for Windows 9, Lee said.

If that sounds familiar, it should: It’s how Bing processes and parses pieces of information to understand that your search for “Adam Levine news” is really for gossip about the Maroon 5 guy – and surfaces news that lets you tell your friends “dude, did you hear, he just dyed his hair!” Doing it for computers is different than doing it for the world wide web, Lee said.

“Bing tries to understand entities. When someone does a Bing search for ‘Canon 4D’ and they click the Canon Rebel link, we learn about those relationships. With enterprise there’s similar issues but with much less data. The computer science ends up being different.”

“If I write a document and I want to say, share this with the appropriate people that work with Vikram from the meeting, or say, ‘what’s trending around me at work,’ not in my personal space but at work … answering questions like that requires a very different kind of machine learning,” he said.

Beyond the algorithm

It’s not all work for Lee. To describe artificial intelligence in action, he cited the AI powering the grunts in the videogame Titanfall.

“It’s been about a week since I last played,” he acknowledged. Ostensibly, it’s an excuse to appreciate how the AI gets smarter over time. But come on. It’s Titanfall.

And besides, there’s more to Microsoft Research than just building a better algorithm or building a better phone. Lee really believes that machine learning and smarter computers could shape society, and bring us to a deeper understanding of what makes us all tick.

“We’re on the cusp of understanding something really important about human nature. It sounds pretentious but that’s a real thing for us.”

“Research is a long game.”

Smart Home

Alexa toilets, robot ovens, and all the other smart home tech coming to CES

CES 2019 is finally here. So what smart home trends can we expect to see this year? Regardless of what you seek, chances are you'll find it on the floor at CES 2019. Here's what we're expecting to see.
Emerging Tech

Researchers discover a way to make 3D printing 100 times faster using light

Researchers at the University of Michigan have invented a new method of 3D printing which is up to 100 times faster than conventional 3D-printing processes. Here's how it works and why it could prove a game-changer for 3D printing.
Emerging Tech

Scientists debate mysterious flash of light in space, known as ‘The Cow’

On June 16, 2018 there was an unusual flash in the sky which puzzled astronomers around the world. NASA researchers have been collecting data on the event and have shared two competing theories for what could have caused it.
Emerging Tech

New research could allow fast diagnosis of viruses like Ebola and Zika

A new development in molecular biology is a step towards instant diagnosis of viruses like Ebola or Zika. Researchers have found a way to use a mobile device to identify plant viruses and potentially animal and human viruses too.
Emerging Tech

A.I. can generate pictures of a finished meal based on just a written recipe

Feeling hungry? Researchers from Tel-Aviv University in Israel have created an A.I. that's able to generate complete photos of meals, based only on reading the written recipes. Here's how.

CES 2019: Tech trends to watch for at the consumer electronics show

With more than 4,400 exhibiting companies and more than 2.7 million square feet of exhibition hall, CES is overwhelming. Here's what to expect from the upcoming show, from A.I. and self-driving cars to 5G networks and 8K televisions.

Can gamers build a society? We’ll find out in Amazon’s ‘New World’

Amazon is building a massively multiplayer game with an entirely unique world and setting. We interviewed three of the game developer’s about why Amazon is taking a risk on ‘New World’ and how the company’s cloud tech makes it…
Emerging Tech

Today, hacks are annoying. In future smart cities, they could kill

Corporate security breaches are becoming so common that people now accept them as part of a digital future. But for smart cities, system hacks could prove far dangerous for citizens.
Digital Trends Live

Digital Trends Live – CES 2019 – Day 2

On today's episode: While we are for sure going to run down all the hottest and most innovative tech announcements of CES 2019, we're also hosting some amazing guests and panels. From the latest VTOL taxi from Bell Helicopters and the…

Ride through the sky and get fit on the fly with the NordicTrack VR Bike

During CES 2019, we tried the NordicTrack Virtual Reality Bike. Combining fitness and gaming, the bike is one of the most interesting approaches to VR traversal we’ve seen. 

The best CES 2019 health gadgets combat stress, pain, and more

We can all use some help with our health and CES 2019 was packed with intriguing devices designed to combat pain and stress, help you monitor blood pressure, reduce tinnitus, and care for the sick or elderly.

These shoes let me stroll through ‘Skyrim,’ and I desperately want to go back

After being funded in just two hours on Kickstarter back in October 2018, Cybershoes has earned itself a place among the coolest VR walking and running tech. At CES 2019, we got to try them out and they live up to the hype.
Smart Home

Treat your furry friend with the best pet tech at CES 2019

We all want the best for our feline companions and furry best friends, so we're seeing more and more innovative gadgets designed for pets. CES 2019 was a veritable treasure trove of pet tech and these devices are our picks.

It took three years, but OLED laptops are having another moment at CES

To our surprise, OLED laptops made a strong showing at CES 2019. With options in the works from most of the major PC manufacturers, it seems OLED is making its comeback.