Microsoft’s head of research opens up about Google X, Windows 9, and the future

Peter Lee Microsoft Research

“I’m not ready to talk about Special Projects,” Peter Lee, head of Microsoft Research, told me on Monday – before he proceeded to tell me all about Special Projects.

Microsoft Research has 1,100 computer scientists, researchers, and engineers in labs all around the world. Add in 1,200 PhD student interns every year, and Microsoft’s R&D department is on the same scale as a good-sized research university. It’s responsible for some remarkable stuff – Cortana, the tech behind Kinect, and so on – yet you almost never hear from the group directly.

The international press has written tens of thousands of articles about Google X, the company’s blue-sky, moon-shot research arm that’s dabbling in anything and everything from self-driving cars to robot moon landers to a cure for death itself, but Microsoft’s own crazy projects haven’t gotten nearly the coverage.

“I like Google X. The people there are good friends of mine.”

Microsoft Research finally earned some long-overdue headlines last week, when ZDNet’s Mary Jo Foley reported on a “Special Projects” group that would tackle disruptive technology and ultimately Google X. But Lee said he’s not frustrated by all of that glowing press Google’s research guys have garnered.

“Frustrating is not quite the right word,” Lee told Digital Trends, in an interview ahead of the ribbon-cutting ceremony for MSR’s New York City office. “I like Google X. The people there are good friends of mine. Astro [Teller, “Captain of Moonshots” with Google X] took classes from me at Carnegie Mellon, he’s a great guy doing great stuff. But the missions are different. We want to make things better and ship them. That will always be primary for us. It will be secondary for them.”

Lee is a corporate vice president at Microsoft, formerly a key department head at DARPA and the guy in charge of Carnegie Mellon’s computer science department before that. He’s also as affable and charming as you could imagine, as well as unexpectedly amusing for a researcher who writes dense technical treatises with names like “Optimizing ML with Run-Time Code Generation” and “Metacircularity in the polymorphic lambda calculus.” (Published in a 1991 issue of Theoretical Computer Science – look it up.)

Microsoft Research vs. Google X

Microsoft Research’s work spans four quadrants, Lee said: One is mission-focused, work requested by other departments for example. A second field is sustaining technologies, improving testing tools for example, or machine translation ability. Then there are disruptive technologies and ultimately that moon-shot stuff.

Microsoft lab quadrant graph“Special projects is really directed at this upper quadrant,” Lee said, pointing to the disruptive quadrant of his grid, which he defined as what’s new and surprising and inventive, rather than the blue-sky, open-ended, curiosity-driven work that pushes the frontiers. “Stay tuned, it’s a cool development for us.”

One directive of new CEO Satya Nadella is for the group to finally put step into the spotlight, something Lee said was a great development.

“I would prefer that the world not have too much envy for Google X.”

“I would prefer that the world not have too much envy for Google X,” he told Digital Trends.

“It’s a good thing for the industry, and it’s a good thing for all of us — to expand what people imagine is possible with technology. That’s something we want to do, and it’s something Google X wants to do. And at the same time we want to do real things that reach real people now, rather than later.”

The Special Projects group will be headed up by Norman A. Whitaker, Microsoft announced last week. Whitaker is former deputy director of the Information Innovation Office at DARPA, where he worked together with Lee way back when.

“DARPA and Microsoft Research are similar in that there is a specific focus in looking beyond the headlights to the next big thing,” explained Lee.

Cortana and machine learning

A big chunk of Microsoft Research is aimed at that blue-sky foundational research, Lee said, not concerned with business imperatives and just looking for the next big thing. Other groups work with specific mandates, tasked by senior management to help different business units with something specific.

That’s where Cortana came from.

Microsoft lab opening 2
Microsoft Research’s new NYC lab

Steve Ballmer himself tasked the team with developing a smart voice-recognition system for the Windows Phone platform, although most such collaborative work isn’t tasked from above. In a few areas there is some high-level company directive, he acknowledged. The research staff in Redmond build a feature called Interactive Classifier into Cortana, which allows a small team of non-expert engineers to do continuous evolution of the system.

“With a very few number of parameters, just a few dozen, you get a continuous improvement,” Lee said. “That’s why it’s in beta. As it gets used, every day Cortana is getting a little bit more human in its responses.”

Windows 9

Another rare, top-down command might shape the next iteration of Windows, which is likely to be called Windows 9 – although Lee declined to even confirm the existence of an update to the OS. New CEO Satya Nadella has made clear his vision of a cloud-enabled Windows. He even stressed it in his first letter to the to the company.

Yet Windows at present doesn’t rely on the cloud for computing power. Sure, there’s OneDrive, a great place to store stuff, and the Office family of apps can be run from the cloud. But unlike other Microsoft products, that’s where the integration ends.

Bing, by contrast, lives and breathes because of the hidden, back-end power of the cloud, as does Siri – and by extension, some of the neatest features of the Windows Phone platform (Android too, of course). But the desktop? Not so much.

That’ll change in Windows 9, if Microsoft Research has anything to say about it.

“One of the mission-focused activities [those dictated by other divisions within the company] is centered around something called the Enterprise Graph. It sounds really boring but for us it’s really interesting,” he said.

Presently, Windows doesn’t rely on the cloud for computing power … That’ll change in Windows 9.

Microsoft has a lot of customers that are big companies with hundreds of thousands of employees. Your smartphone may realize you take the same route to work everyday, thanks to data stored and analyzed in the loud, but Windows apps and the OS itself just don’t get it.

“Using machine learning to extract relationships, entities, key ideas being worked on and bring those to the surface in tools. Maybe even digital-assistant tools to make companies more productive and smarter. That’s one area we’re going at” for Windows 9, Lee said.

If that sounds familiar, it should: It’s how Bing processes and parses pieces of information to understand that your search for “Adam Levine news” is really for gossip about the Maroon 5 guy – and surfaces news that lets you tell your friends “dude, did you hear, he just dyed his hair!” Doing it for computers is different than doing it for the world wide web, Lee said.

“Bing tries to understand entities. When someone does a Bing search for ‘Canon 4D’ and they click the Canon Rebel link, we learn about those relationships. With enterprise there’s similar issues but with much less data. The computer science ends up being different.”

“If I write a document and I want to say, share this with the appropriate people that work with Vikram from the meeting, or say, ‘what’s trending around me at work,’ not in my personal space but at work … answering questions like that requires a very different kind of machine learning,” he said.

Beyond the algorithm

It’s not all work for Lee. To describe artificial intelligence in action, he cited the AI powering the grunts in the videogame Titanfall.

“It’s been about a week since I last played,” he acknowledged. Ostensibly, it’s an excuse to appreciate how the AI gets smarter over time. But come on. It’s Titanfall.

And besides, there’s more to Microsoft Research than just building a better algorithm or building a better phone. Lee really believes that machine learning and smarter computers could shape society, and bring us to a deeper understanding of what makes us all tick.

“We’re on the cusp of understanding something really important about human nature. It sounds pretentious but that’s a real thing for us.”

“Research is a long game.”


Midrange phones can’t do A.I., but MediaTek’s P90 chip aims to change that

MediaTek has announced the Helio P90 mobile processor, which it says will bring the best A.I. features we see on high-end smartphones, to the mid-range. We spoke to the company about the chip.
Emerging Tech

Researchers create a flying wireless platform using bumblebees

Researchers at the University of Washington have come up with a novel way to create a wireless platform: using bumblebees. As mechanical drones' batteries run out too fast, the team made use of a biology-based solution using living insects.
Emerging Tech

CRISPR gene therapy regulates hunger, staves off severe obesity in mice

Researchers from UC San Francisco have demonstrated how CRISPR gene editing can be used to prevent severe obesity in mice, without making a single edit to the mouse's genome. Here's how.
Emerging Tech

Transplanted pig hearts show promise in baboon trials. Are humans next?

Researchers in Germany have successfully transplanted modified pig hearts into baboons. The results take us one step closer to ending organ transplant waiting lists for good. Here's why.
Smart Home

With Personal Food Computers, nerd farmers are finding the best way to grow

MIT research scientist Caleb Harper wants to grow basil designed to prevent heart disease. It involves a personal food computer, climate manipulation, and open sourcing food. One day, your doctor could prescribe you a diet of food grown…
Smart Home

How Alexa and Google Home can lend a hand over the holidays

Voice assistants are great helpers in the kitchen, so Alexa and Google Home are extra useful for holidays. Here are some ways your smart speakers can keep you in the holiday spirit.
Emerging Tech

Time for test-tube turkey? Everything you need to know about lab-grown meat

Lab-grown meat is big business. A handful of enterprising startups have raised and invested hundreds of millions of dollars into nascent technology, banking on breakthroughs in biotech to revolutionize the food industry.
Health & Fitness

Dread the gym? This smart mirror delivers your fitness fix at home

Mirror, launched back in September, is part mirror and part LCD display with on-demand workouts built into it. We visited Mirror's HQ in NYC to test it out and to see if it's really worth cancelling that gym membership for.

To capture nature’s insanity, this storm chaser built his own 16K camera rig

Sure, 16K cinema cameras don't yet exist -- but that doesn't mean you can't make your own. Storm chaser and producer Martin Lisius recently captured a 16K time-lapse film that showcases the powerful beauty of supercell storms.

The best Black Friday tech deals from across the web, all in one place

Amazon, Walmart, and Best Buy are offering the best online Black Friday deals, and we've worked hard gathering all of those sweet savings into one convenient location. Get them before their gone!
Emerging Tech

Electric bikes and scooters are here to save the world! But here’s the thing …

E-bike and e-scooter usage has increased in popularity, but also troublesome. Providing these two-wheeled alternative transports while keeping users safe, is what smart cities are grappling with.

How bike tech lets Red Bull Rampage riders flirt with death, and survive

Red Bull Rampage is the craziest mountain bike event in the world, pushing riders to their limits. Fortunately they are armed with some of the best bike technology around, allowing them survive this wild and dangerous competition.

7 insane roads that will push self-driving cars to their very limits

Self-driving cars are getting better all the time, but we won't ever be convinced of their readiness for prime time till we see them comfortably handle some of the world's craziest roads. Here are our picks.

Where Toronto sees smart sidewalks, residents see ‘1984.’ So what now?

Google-parent Alphabet is partnering with Toronto to develop a new, smart neighborhood, but some are concerned about privacy and the company’s motives. Could residents derail the project?