Skip to main content

Nvidia releases developer tools for VR audio and live 360-degree streaming

Nvidia has detailed two new additions to its VRWorks software development kit (SDK) at the GPU Technology Conference 2017 in San Jose, California. The company has released its VRWorks Audio SDK, as well as its VRWorks 360 Video SDK, both of which should help developers create more immersive virtual reality content.

There are already methods of creating VR experiences that accurately simulate the position of audio sources in relation to the user. However, these methods don’t tend to take into account the physical properties of the environment, which can cause various different kinds of aural distortion.

Recommended Videos

The VRWorks Audio SDK models things like reflection, refraction, and diffraction, according to a blog post published by Nvidia earlier today. The SDK tracks the path of audio in real time, without utilizing a pre-baked version of the scene, instead building an acoustic model of the scene and updating it on the fly.

Meanwhile, the VRWorks 360 Video SDK helps facilitate 360-degree video capture at a 4K resolution, along with stitching and streaming, all in real time. This should make high-quality 360-degree video a very attainable project for scores of VR developers, assuming that they have a compatible camera to capture the footage.

Live-streaming this kind of video could be a game changer, if Nvidia’s real-time stitching technology works as advertised. At the GTC event, the company is previewing an upcoming version of its VRWorks 360 Video SDK that’s capable of real-time stitching in stereo. According to Nvidia’s marketing materials, two Quadro P6000 GPUs can be used to stitch a total of eight 4K cameras in stereo, with ZCAM’s V1 Pro VR camera being used to demonstrate these capabilities.

Nvidia will be showing off both features at GTC, until the event concludes on May 11. Developers can start getting to grips with the new VRWorks functionality right now by downloading the SDKs from the company’s website.

Brad Jones
Brad is an English-born writer currently splitting his time between Edinburgh and Pennsylvania. You can find him on Twitter…
Nvidia built a massive dual GPU to power models like ChatGPT
Nvidia's H100 NVL being installed in a server.

Nvidia's semi-annual GPU Technology Conference (GTC) usually focuses on advancements in AI, but this year, Nvidia is responding to the massive rise of ChatGPT with a slate of new GPUs. Chief among them is the H100 NVL, which stitches two of Nvidia's H100 GPUs together to deploy Large Language Models (LLM) like ChatGPT.

The H100 isn't a new GPU. Nvidia announced it a year ago at GTC, sporting its Hopper architecture and promising to speed up AI inference in a variety of tasks. The new NVL model with its massive 94GB of memory is said to work best when deploying LLMs at scale, offering up to 12 times faster inference compared to last-gen's A100.

Read more
Nvidia is leveraging GPUs to build 2nm (and smaller) chips
Nvidia's cuLitho technology on a silicon wafer.

As part of Nvidia's GPU Technology Conference (GTC), the company announced a new software library that will enable 2nm and smaller transistors. The library is called cuLitho, and Nvidia has already partnered with the world's largest semiconductor companies to use the tech, including TSMC and Synopsys.

The software stack is built for computational lithography, which is the process of etching the components of a processor into a silicon wafer. Lithography has gotten more complex as the demand for smaller manufacturing processes has increased, but the current technology has reached an inflection point.

Read more
Nvidia did AMD a huge favor by releasing the RTX 4070 Ti
RX 7900 XTX and RX 7900 XT on a pink background.

When AMD released the RX 7900 XTX and the RX 7900 XT, it was clear which of the two would be stealing the spotlight. The RX 7900 XTX is a solid GPU, and its weaker sibling is very much overshadowed by it. However, now that Nvidia launched its RTX 4070 Ti, there's hope yet for AMD.

It might sound strange, but Nvidia may have actually done AMD a huge favor by releasing the RTX 4070 Ti the way it did.
AMD's RX 7900 XT is one odd GPU

Read more