Nvidia plans to prove that new method improves image quality in virtual reality

During SIGGRAPH 2016, taking place next week in Anaheim, California, Nvidia Research plans to demonstrate methods to improve the quality of foveated rendering in virtual reality. Nvidia believes that its new set of “perceptually motivated” methods offer better image quality than what’s served up in current algorithms for virtual reality. These rendering methods also enable “significant” reduction in rendering cost without sacrificing visual quality.

As a brief explainer, we humans have two vision systems. First, there’s foveal vision that’s sharp, detailed, and our brain’s main visual pipeline of information. Consider that little spot at the back of your retina, the fovea, as a black hole of sorts, a place where your visual perception is the highest and where most of the retinal cones reside.

And then there’s peripheral vision, which provides our brain with secondhand visual information. While extremely useful, peripheral vision lacks the detail we see through foveal vision, supplying mostly colors and movement. It allows us to acknowledge that the weather is rather rainy outside without having to turn our head and look directly out the window.

Thus, these two systems have led to the development of foveated rendering systems that emulate our own eyeball inputs. A Google search will bring up foveated imaging, which essentially blurs the picture in certain areas so that the viewer focuses on a specific point. However, according to Nvidia, foveated rendering systems have been in use for around 20 years.

“A significant reduction in human visual acuity occurs between images forming on the center of the retina (the fovea) and those outside the fovea (the periphery). Various optical and neural factors combine to cause this quality degradation, which increases with distance from the fovea, and is known as foveation. Foveated rendering algorithms exploit this phenomenon to improve performance,” states an overview provided by Nvidia Research (PDF).

According to the Nvidia Research team, current foveated rendering algorithms can disrupt the virtual reality experience by, for example, creating a sense of tunnel vision because the peripheral blur is too heavy. Temporal aliasing is another “artifact” that causes objects to jump or automatically appear because the frame rate in the surrounding scenery is too slow as object “transformation” is taking place.

Aaron Lefohn from the Nvidia Research team recently said that the new foveated rendering methods can reduce pixel shading performance in the peripheral area by double or triple. That performance savings can thus be applied to the virtual realm’s main focal area, providing a more detailed, realistic experience.

To demonstrate the new foveated rendering techniques next week, Nvidia Research will use a prototype based on the second-generation Oculus Rift Development Kit (DK2) and a special high-speed gaze tracker provided and installed by SensoMotoric Instruments. This latter device will run at a 250Hz frequency and have a response latency of 6.5ms.

On the software side, the demonstration will have a real-time rendering testbed based on OpenGL and GLSL. This testbed will render 3D scenes in stereo at 75Hz and use “live” data pumped in through the high-speed gaze tracker. This will allow Nvidia Research to showcase its new foveated rendering techniques against several existing techniques used in VR today.

“Our testbed uses high-quality anti-aliasing techniques to ensure temporal stability in foveated rendering. We enable 8 (times) multisample anti-aliasing, and have implemented a TAA algorithm inspired by Unreal Engine 4 [Karis 2014], modified to work with all of the above techniques,” the team adds.

Of course, we won’t see this new technology in consumer-based VR until headset makers implement eye-tracking technology. That may be a year or two, when hardware component prices drop to a decent level. Until then, you can see the difference Nvidia Research’s new methods made in a blog post right here, and in the video below.

Emerging Tech

What’s it like to die? This VR experience puts doctors in a dying man’s shoes

A new VR experience depicts the last days of a lung cancer patient. It is already being used as a teaching tool in hospices and medical schools. But can VR really make us more empathetic?
Computing

Secure your Excel documents with a password by following these quick steps

Excel documents are used by people and businesses all over the world. Given how often they contain sensitive information, it makes sense to keep them from the wrong eyes. Thankfully, it's easy to secure them with a password.
Social Media

Build a wish list and shop videos with Instagram’s latest shopping update

Eyeing a product on Instagram? Now there are more ways to shop from the social network. Instagram just rolled out options to save products in a collection as users can also now shop from videos.
Emerging Tech

Sticking these tiny needles in your eye may help fight blindness

An eye patch covered in tiny needles sounds like a torture device. In fact, it's a potential new medical treatment for eye diseases like glaucoma and macular degeneration. Here's how it works.
Cars

Quick! Someone petition Ferrari to make this luscious tribute to the F40

Ferrari looks toward the future as it designs hypercars like the LaFerrari. Designer Samir Sadikhov turned his eye toward the past to create a modern interpretation of the 1987 F40 without venturing into full retro territory.
Photography

Intel’s augmented reality brings Red Bull Rampage into your living room

The extreme mountain biking action of Red Bull Rampage is coming to your living room thanks to the power of augmented reality and 360-degree video that lets fans load a scale replica of the course right in their phones.
Mobile

From the road to your wrist, see how Android has evolved over the past 10 years

Android started out as just a mobile operating system, but 10 years in it's pretty much everywhere. Check out our round-up of all the different Android variations that have cropped up so far, and what might be coming in the future.
Photography

With flip-out lenses, the Vuze XR transforms from 2D to 180-degree VR camera

The Vuze XR is a compact, dual-lens camera with an integrated handle and a neat party trick: The back-to-back lenses can flip forward to transition from 360-degree, two-dimensional video to 180-degree, three-dimensional video.
Computing

Following the Portal, augmented reality glasses may be Facebook’s next step

Following the launch of its Portal smart display, Facebook says it is working on AR glasses, possibly in a move at challenging both Apple and Google and perhaps to rise up in the hardware scene. 
Emerging Tech

Here’s all the best gear and gadgetry you can snag for $100 or less

A $100 bill can get you further than you might think -- so long as you know where to look. Check out our picks for the best tech under $100, whether you're in the market for headphones or a virtual-reality headset.
Computing

Oculus VR could upgrade the Rift with a new display in 2019

Oculus could be set to release a new version of its Rift headset in 2019, but it will be more of a modest upgrade than a true sequel. The Rift S, as its purportedly called, will have a new display, and inside-out tracking.
Mobile

Google awarded patent for using eye tracking to detect expressions in VR

Google was awarded a patent that involves using eye tracking to infer facial expressions using machine learning in virtual reality. The tech could help make virtual reality a whole lot more immersive than it already is.
Gaming

Immerse yourself in a new universe with these incredible PSVR games

The PSVR has surpassed expectations and along with it comes an incredible catalog of games. There's plenty of amazing experiences to be had so we've put together a list of the best PSVR games available today.
Virtual Reality

Prototype Valve VR headset leaked: HTC Vive challenger confirmed?

Leaked images revealed that a Valve VR headset is in development, even amid Valve's partnership with HTC for the HTC Vive. Sources confirmed the device, which may be bundled with a Half-Life VR game.