Adaptive Focus VR video could consume 80 percent less data

tech deals
YouVisit, a virtual reality (VR) services company, is working on a VR video algorithm it calls Adaptive Focus. The algorithm dynamically raises the resolution of video content based on where the user is looking. The algorithm has the potential to solve two major issues in VR today: Videos often aren’t rendered at top resolution due to hardware limitations, and streaming 360 video of course consumes a ton of data.

If you’re the owner of a Gear VR and one of Samsung’s recent flagships, you know how much storage space can get eaten up by video content. You’ve probably also noticed how very few videos actually seem to be rendered at its 1440p display resolution. The main reason for this is that the video you’re typically looking at is being rendered all around you, regardless of whether you’re looking at it or not.

Most phones simply can’t handle that type of pressure, so a lot of the VR video you see is rendered at a lower total resolution to allow your phone to handle all of that extra rendering. It also ensures you typically don’t run out of storage capacity the very same day you bought the phone. The result is that you simply can’t watch a lot of videos at their native resolution, and this is where Adaptive Focus comes in. Since it only renders the area that you’re focusing on, it can allocate hardware to render a smaller area at the highest possible resolution instead of simultaneously rendering all the footage that is in your peripheral vision.

Digital Trends talked to YouVisit’s CEO and co-founder, Abi Mandelbaum, as well as the company’s CTO, Taher Baderkhan (who is also a co-founder). We also had the opportunity to try on an early demo of the technology using a Galaxy Note 4 as well as the Gear VR Innovator Edition, to get a sense of how the technology worked. Both executives are keen to push Adaptive Focus as a solution for streaming, rather than playing files saved locally on your phone.

Mandelbaum explained that “Streaming is what most people do now. The way we look at it, the reason people download is because of the low resolution they have to look at when they stream 360-degree video. As a result people say ‘streaming isn’t good enough, we’re going to download it.’” Baderkhan added that “The amount of data the user will save will be around 80 percent. A video that we send at 1mb/s in adaptive focus will be equivalent in quality to a video sent at 5mb/s in standard mode,” he says.

An example image. But no, the difference isn't that extreme
An example image from the video demo. But no, the difference isn’t that extreme

Our experience with Adaptive Focus was promising but there were disturbing delays as you moved your head around. According to YouVisit, the delay was 2.5 to 3 seconds, and that felt similar to our experience. The company is making strides to lower that number though, and Baderkhan says that the most recent version has a delay that’s been shortened to between 0.5 to 1.2 seconds. In the demo we could switch between standard 360 video to a Adaptive Focus version, and while the standard had artifacts (and more of them than we usually see from a 2GB VR video file), the dynamic video footage certainly got its point across.

It’s easy to see how this would save a lot of data for VR consumers on the move, but it’s hard to say whether we’d prefer uninterrupted playback or higher resolution. On the other hand, these sorts of technical issues should be possible for YouVisit to patch up in the future and perhaps the experience wouldn’t disrupt immersion as much with shorter delay times.

For now, Adaptive Focus is limited to YouVisit’s own content, but the company is also working to create an SDK for other app developers. The video format is intended to be released sometime in the second quarter of 2016, and if the developer’s plans come to fruition we may be looking at a wider developer adoption and even lower video delays after the format is launched.

Mobile

From the road to your wrist, see how Android has evolved over the past 10 years

Android started out as just a mobile operating system, but 10 years in it's pretty much everywhere. Check out our round-up of all the different Android variations that have cropped up so far, and what might be coming in the future.
Smart Home

Got an Emerson thermostat? 135,000 of them are being recalled due to fire risk

Most recalls are relatively benign but if you own an Emerson-branded thermostat, we encourage you to check your model number because the company has alerted consumers to the potential of the device starting a fire.
Photography

These are the best action cameras money can buy

Action cameras are great tools for capturing videos of your everyday activities, whether it's a birthday party or the steepest slope you've ever descended on your snowboard. These are the best money can buy.
Photography

From DSLRs to mirrorless, these are the best cameras you can buy right now

From entry-level models to full-frame flagships, many cameras take great photos and video. The best digital cameras, however, push the industry forward with innovative sensors and improved usability, among other things. Here are our…
Movies & TV

The best movies on Amazon Prime right now (December 2018)

Prime Video provides subscribers with access to a host of fantastic films, but sorting through the catalog can be an undertaking. Luckily, we've done the work for you. Here are the best movies on Amazon Prime Video right now.
Computing

Following the Portal, augmented reality glasses may be Facebook’s next step

Following the launch of its Portal smart display, Facebook says it is working on AR glasses, possibly in a move at challenging both Apple and Google and perhaps to rise up in the hardware scene. 
Computing

Oculus VR could upgrade the Rift with a new display in 2019

Oculus could be set to release a new version of its Rift headset in 2019, but it will be more of a modest upgrade than a true sequel. The Rift S, as its purportedly called, will have a new display, and inside-out tracking.
Mobile

Google awarded patent for using eye tracking to detect expressions in VR

Google was awarded a patent that involves using eye tracking to infer facial expressions using machine learning in virtual reality. The tech could help make virtual reality a whole lot more immersive than it already is.
Gaming

Immerse yourself in a new universe with these incredible PSVR games

The PSVR has surpassed expectations and along with it comes an incredible catalog of games. There's plenty of amazing experiences to be had so we've put together a list of the best PSVR games available today.
Virtual Reality

Prototype Valve VR headset leaked: HTC Vive challenger confirmed?

Leaked images revealed that a Valve VR headset is in development, even amid Valve's partnership with HTC for the HTC Vive. Sources confirmed the device, which may be bundled with a Half-Life VR game.
Virtual Reality

Is the Vive Pro better than the original Vive? Our answer might surprise you

HTC Vive vs. Vive Pro, which comes out on top? That's the subject of our latest comparison, which looks at everything from tracking solutions, to controllers, and the brand new headset that could set a new standard for VR.
Gaming

The best HTC Vive games available today

So you’re considering an HTC Vive, but don't know which games to get? Our list of 25 of the best HTC Vive games will help you out, whether you're into rhythm-based gaming, interstellar dogfights, or something else entirely.
Computing

A Google patent shows a way to make VR even more immersive

Virtual reality can be a really immersive experience, but it does sometimes it does have boundaries. Google has addressed this problem by patenting shoes with a flexible region on the bottom.
Virtual Reality

Think virtual reality is just for games? These awesome apps will change your mind

Virtual reality isn't all about gaming. Swim with turtles, paint in 3D, and immerse yourself in some unique experiences the platform has to offer with our curated list of the best VR apps.