Can a phone A.I. control a car? We hopped in a Huawei-driven Porsche and found out

Climbing into the black Porsche Panamera, as the snow began to fall heavily outside, the Mate 10 Pro stuck to the windshield caught our attention. It looked like it was there to help with navigation; but we knew better. A cable running from the USB port deep down into the car revealed its true purpose. The phone was going to drive the car, and make sure we didn’t hit something that would suddenly appear in front of us.

Nervous? Wouldn’t you be?

Can a smartphone really power a driverless car? At MWC 2018, we found the answer to this question is yes, provided the phone is adept at harnessing artificial intelligence. Huawei invited us along to a demonstration of Project Road Reader, which despite outward appearances isn’t the announcement of its intention to build an autonomous car; but a very visual and exciting way to show off the capabilities of its Kirin 970 processor and its Neural Processing Unit (NPU) inside the Mate 10 Pro phone.

Demonstrating the power of AI

As a term, “artificial intelligence” has lost much of its meaning recently, due to so many products and services being promoted as having some kind of AI behind it. Huawei launched the Mate 10 Pro phone with the NPU last year and struggled to illustrate the chip’s benefits effectively. We saw it at work in the camera app, and throughout the operating system; but its hard to understand how powerful it really can be. That’s why Huawei fitted a modified Porsche Panamera with a Mate 10 Pro and drove journalists towards fake bikes, balls, and animals.

The Mate 10 Pro’s job was to recognize hazards popping up in front of it, and take appropriate action. Think about that: The same phone you use for Twitter, email, and calling a friend, is also clever enough to see and recognize an object, while moving at speed, then make the decision to carry out a pre-determined action.

This isn’t some beefed up Mate 10 Pro. It’s a standard, out-of-the-box phone.

To make it clear, this isn’t some beefed up Mate 10 Pro. It’s a standard, out-of-the-box phone. The image recognition has the same capabilities too, it has just been taught something new. It has to recognise bikes, balls, and dogs, and not sunsets or snow. No changes have been made at all, outside of an app to control the car being produced. This was made with Huawei’s readily available development kit, and in theory, with the right talent, car, and private race track, anyone could replicate the same experience. However, it’s not recommended, for obvious reasons.

Why the Panamera? Porsche’s car was chosen because it’s not autonomous at the moment. The modified car here is controlled by hydraulics and servos — the driverless part is mechanical rather than electronic or robotic. On the top is a ski box protecting a large camera from the weather — it was actually snowing during our test. Although the Mate 10 Pro’s own cameras could be used, there were concerns about then being obscured by the windscreen, or something falling on it. Safety first.

Taking control

The camera films the road ahead and delivers the information to the Mate 10 Pro by HDMI cable, scanning for objects, which it can recognise at 30 frames per second (fps). This uses the same tech that the camera uses to improve pictures. None of the AI processing happens in the cloud, it’s all done on the device, which is the NPU’s real special ability.

huawei artificial intelligence driverless car demo press front seats
Huawei
Huawei

The first run was taken at 5 mph, and three objects were randomly presented in the road ahead of the car, allowing the Mate 10 Pro to capture and recognize them. A total of 1,000 common objects found on or near roads had been programmed into the phone. Once the learning phase was complete, we told the phone what we’d like to do when it encountered one or more of these objects on the next run. For example, brake when it sees the dog, or swerve when it sees a bike.

No bikes, fake cyclists, real journalists, or expensive Panameras were hurt or damaged.

With this done, it was time for the main run, which would be at 30mph — significantly faster, and the true test of the Mate 10 Pro’s ability. Huawei claims it could safely react up to 60 mph, but space constraints prevented us from finding out.

The car set off abruptly, reaching its target speed immediately. What happened next was over in a split second, as the fake bike came into its path, the Mate 10 Pro saw it, and swerved in the direction we had previously told it to. No bikes, fake cyclists, real journalists, or expensive Panameras were hurt or damaged.

Further potential

The fact a phone did this is impressive enough, but not just any phone could have been used in the demonstration. The developers tried out other phones, but the image recognition wasn’t robust enough. The NPU inside the Mate 10 Pro helps the phone recognize 2,000 images per minute, while on some other flagships this number drops down to around 500, or even as low as 80.

Impressively, the demo could be taken a stage further, with the system reacting intelligently to an emergency situation. Anyone knows that if a ball rolls into the road, a child is likely to follow. Standard radar systems on autonomous cars don’t know this, and a computer is required to make those calls. The Mate 10 Pro is capable of doing that job.

What does this mean for us, if Huawei isn’t about to offer a Mate 10 Pro-controlled car? It’s a visual showcase of the NPU’s prowess and AI’s growing ability, in a way people can better understand. Huawei told us there are a lot more things to do with the onboard AI coming soon. While the camera is the most prominent feature for AI at Huawei, there are many other possibilities for the future, some of which may be revealed when the P20 arrives at the end of March, a fact also revealed by CEO Richard Yu when we spoke to him at the show.

No, we won’t be getting a car that’s controlled by a phone in the near future, but there is one out there with enough processing power and smarts to actually do so. That means taking better photos and making my life easier should be comparatively easy by comparison, and that’s very reassuring.

Cars

Formula 1 is putting data in the driver’s seat, and not all racers are happy

After a single weekend of racing, a Formula 1 pit crew typically pulls around 2TB of data from the car. Everything, from tire pressure to the temperature of the track, is recorded and analyzed in the name of boosting performance -- and not…
Product Review

With the S10e and S10 Plus, do we really need the Samsung Galaxy S10?

The Galaxy S10 is the middle child in this year’s Galaxy S10 range, between the Galaxy S10e, and the Galaxy S10 Plus. There’s no striking reason to buy it, but it’s still an excellent phone you’ll be happy with.
Product Review

There’s almost nothing bad to say about the Mi Mix 3, but you still shouldn’t buy it

The Xiaomi Mi Mix 3 is good-looking, really well made, packed with features, and is a powerful, modern, desirable smartphone. But you probably shouldn’t buy it. Why? Nothing wrong with the device itself, but Xiaomi itself is mostly to…
Mobile

Does this video show off the Huawei P30 Pro's impressive camera suite?

The Huawei P30 Pro will be announced on March 26. It has already started to leak ahead of this date, and expectations are high that the company will improve even further on the P20 Pro's camera.
Mobile

Scientists wreck a smartphone in a blender, but not just for fun

It’s oddly mesmerizing to watch a smartphone get torn apart inside a blender. Researchers recently did just that in a bid to find out which materials make up a handset, and also to encourage people to think more about recycling.
Movies & TV

Apple’s next big event is minutes away: Here’s what you can expect

Apple's next big event takes place on March 25 in Cupertino, California. The company is expected to make several announcements related to its services, including Apple TV, so follow our guide to get ready for the big event.
Wearables

This $76,000 Grand Seiko watch has something in common with a plug-in hybrid car

How can a watch that costs $76,000 possibly have anything in a common with any car, let alone a plug-in hybrid? It's all about the complex, technically incredible Spring Drive movement inside this Grand Seiko watch.
Deals

The excellent Apple iPad gets even deeper price cuts on Amazon

The humble iPad from 2018 is still one of the best tablets around -- and a solid choice for most people. Amazon has seen some great price drops for these tablets recently, and now you can own an iPad for even less than before.
Mobile

More than a screenshot: How to record the screen on an Android device

If you've ever want to record video of your Android screen, there are plenty of apps that can help. Here's an easy guide on how to record the screen on an Android device with the right settings and apps.
Apple

Apple March 2019 Event Coverage

Apple’s next event will take place March 25 at the Steve Jobs Theater in Cupertino, California at 10 a.m. PT. We’ve got a handy guide on how to watch, but don’t expect to see any new iPads, iMacs, or AirPods at the show, all of…
Product Review

Want to see how powerful the Snapdragon 855 chip is? Just rev up the Xiaomi Mi 9

How fast do you want to go? If the answer to this is “as fast as possible,” then take a long look at the Xiaomi Mi 9. It’s one of the highest performance smartphones you can buy. It’s a real monster, and we’ve been using it.
Mobile

Apple Card is a credit card you can sign up for and start using with your iPhone

Apple is getting into the credit card business. Apple Card is a credit card you can sign up for directly on your iPhone, and it doesn't have fees. There's a lower interest rate and you can even get Daily Cash from all purchases.
Gaming

Apple Arcade might be the new game subscription service worth signing up for

Apple Arcade will launch this fall bringing a new game-subscription service with cross-platform support for iOS, Mac, and Apple TV. At launch, the service will feature more than 100 exclusive games, with more added to the service regularly.
Mobile

Check out 22 of the best iPhone 7 cases and covers for your shiny new phone

The iPhone 7 might be attractive, but it’s not rugged. To keep your device in pristine condition, you really need to think about proper protection. That's why we've rounded up some of the best iPhone 7 cases and covers available.