Skip to main content

Engineers build new camera capable of taking pictures in five dimensions

Stefan Heist, Friedrich Schiller University / Fraunhofer IOF

Engineers in Germany have developed a new compact imaging system that’s capable of recording hyperspectral images in five dimensions. This 5D process means capturing data related to multiple wavelengths of light, along with spatial coordinates, as a function of time. The 5D system represents the first laboratory setup in which high-quality spatial and spectral resolution, depth accuracy, and high frame rate imaging have all been combined into a single compact system. It opens up exciting possibilities for security, medical imaging — and even grocery shopping.

The basic principle of the sensor is not dissimilar to the stereo vision that we possess as humans. However, instead of two eyes, which are limited to the detection of only visible light, the 5D imaging system utilizes two hyperspectral cameras operating in the visible to near-infrared range. Because the scene is captured from two slightly different directions, it’s possible to establish the depth information by identifying points on the surface that are present in both camera views. These images can be taken as rapidly as 17 frames per second, making this system faster than similar ones.

Related Videos

“There is a rapidly growing number of applications, which require the determination of more than just one property of macroscopic measurement objects,” Stefan Heist, research group leader at Friedrich-Schiller University, Jena, and the Fraunhofer Institute for Applied Optics and Precision Engineering, told Digital Trends. “Whether in medical imaging, precision agriculture, or optical sorting, for meaningful and reliable results, both the shape of the objects and their spectral properties have to be measured.”

The technology could prove useful for taking historical records of cultural artifacts — not just how they appear but also their material composition. To showcase this application, the researchers used their 5D camera to digitally document a historical relief globe from 1885. It could also be used for rapid, contactless identification of persons for security purposes — with spectral information adding another layer to existing biometric systems.

Right now, the imaging system is about the size of a laptop, although the researchers are hoping to shrink it further. “If the entire sensor can be further miniaturized so that it can eventually be placed in the smartphone, end users at home can [also] benefit from the technology,” Heist said. “It could then be used, for example, for the fast inspection of the condition of fruit or vegetables, or for personal medical monitoring.”

While he noted that the implementation of some of these uses cases will “take some time,” this is still an exciting step forward when it comes to imaging technology.

You can read more about it in a research paper recently published in the journal Optics Express.

The next big thing in science is already in your pocket
A researcher looks at a protein diagram on his monitor

Supercomputers are an essential part of modern science. By crunching numbers and performing calculations that would take eons for us humans to complete by ourselves, they help us do things that would otherwise be impossible, like predicting hurricane flight paths, simulating nuclear disasters, or modeling how experimental drugs might effect human cells. But that computing power comes at a price -- literally. Supercomputer-dependent research is notoriously expensive. It's not uncommon for research institutions to pay upward of $1,000 for a single hour of supercomputer use, and sometimes more, depending on the hardware that's required.

But lately, rather than relying on big, expensive supercomputers, more and more scientists are turning to a different method for their number-crunching needs: distributed supercomputing. You've probably heard of this before. Instead of relying on a single, centralized computer to perform a given task, this crowdsourced style of computing draws computational power from a distributed network of volunteers, typically by running special software on home PCs or smartphones. Individually, these volunteer computers aren't particularly powerful, but if you string enough of them together, their collective power can easily eclipse that of any centralized supercomputer -- and often for a fraction of the cost.

Read more
Why AI will never rule the world
image depicting AI, with neurons branching out from humanoid head

Call it the Skynet hypothesis, Artificial General Intelligence, or the advent of the Singularity -- for years, AI experts and non-experts alike have fretted (and, for a small group, celebrated) the idea that artificial intelligence may one day become smarter than humans.

According to the theory, advances in AI -- specifically of the machine learning type that's able to take on new information and rewrite its code accordingly -- will eventually catch up with the wetware of the biological brain. In this interpretation of events, every AI advance from Jeopardy-winning IBM machines to the massive AI language model GPT-3 is taking humanity one step closer to an existential threat. We're literally building our soon-to-be-sentient successors.

Read more
The best hurricane trackers for Android and iOS in 2022
Truck caught in gale force winds.

Hurricane season strikes fear into the hearts of those who live in its direct path, as well as distanced loved ones who worry for their safety. If you've ever sat up all night in a state of panic for a family member caught home alone in the middle of a destructive storm, dependent only on intermittent live TV reports for updates, a hurricane tracker app is a must-have tool. There are plenty of hurricane trackers that can help you prepare for these perilous events, monitor their progress while underway, and assist in recovery. We've gathered the best apps for following storms, predicting storm paths, and delivering on-the-ground advice for shelter and emergency services. Most are free to download and are ad-supported. Premium versions remove ads and add additional features.

You may lose power during a storm, so consider purchasing a portable power source,  just in case. We have a few handy suggestions for some of the best portable generators and power stations available. 

Read more