Skip to main content

New A.I. system could upgrade smartphone cameras

Your smartphone camera might soon be getting a big upgrade thanks to the power of artificial intelligence.

A startup is using new technology to pack the power of a DSLR into phones. Glass Imaging wants to boost smartphone camera quality using deep neural networks and a new kind of sensor.

Related Videos

“By rethinking the optical system from the ground up to be tailor-made for smartphones, we managed to fit huge CMOS sensors that collect around 9x more light than traditional designs,” Ziv Attar, the company’s CEO, said in a news release. “Our state-of-the-art A.I. algorithms seamlessly correct all the distortions and aberrations, and as a result, smartphone image quality is radically increased, up 10x.”

Smarter lenses

A hand holds the DISH Celero 5G smartphone, with a close-up of the camera module.
Celero 5G

Attar explained in an interview with TechCrunch that up until recently, smartphone companies tried to improve image quality by using larger sensors and wider lenses. However, even with noise-reduction algorithms, the resulting imagery using this method ends up looking “weird and fake.”

To solve the image quality problem, Glass plans to put a larger lens inside a smartphone, but today’s ultraslim phones don’t have enough room to fit in the bigger optics. So, Glass instead intends to change the aspect ratio of the smartphone sensor. The company’s proposed method is to leverage the concepts behind anamorphic lenses. Anamorphic is a filmmaking technique of shooting for widescreen on 35mm film or sensors. The lenses fit the larger field of view to fit on a sensor, and then the footage is de-squeezed in postproduction to create a wider aspect ratio.

Mario Pérez, a professional photographer, said in an interview that anamorphic lenses had been used for years mainly for cinematic productions. But today. photography and videography enthusiasts have access to a wide array of anamorphic lenses.

“The main benefit these lenses bring is the ability to fit a wider angle of view than regular lenses, all within a small, average camera sensor, without any visible distortion (provided the video is duly processed later on),” he added.

Pérez said that it’s become relatively easy to get a phone with a regular lens and then attach a third-party anamorphic lens to it, which will get you many of the typical features a cinematic anamorphic lens offers: Wider angle of view, intense “bokeh” effect, and flares on light sources, among other benefits.

“Smartphone industry is evolving at an incredibly rapid pace,” Pérez said. “Videographers and photographers are shifting towards working with smartphone cameras as these grow in specs and performance. I wouldn’t be surprised to see smartphone brands equipping smartphone cameras with anamorphic lenses at some point soon, very much in accordance with how Apple added Cinematic Mode (Focus Shift) to iPhone 13 Pr, for instance.”

When it comes to smartphone camera innovations, Pérez said that variable focal length is another bold feature that will make a huge difference when it becomes a reality. Currently, the only way smartphone cameras can offer different focal lengths is by putting together two or more lenses with different focal lengths. The only exceptions to that are the Sony Xperia 1 III and and Xperia 5 III, both of which have moving lenses in the periscope telephoto module that provide different focal lengths. But it’s certainly a rarity.

“The day a smartphone brand will offer us, photographers and videographers, the ability to shoot with our smartphone camera at different focal lengths, all from one single lens, that day will mark the beginning of a new era in the industry of visual content creation,” Pérez said.

New takes on the camera lens

image of a city street with depth information displayed as colors.

Glass isn’t the only company trying to use new techniques to make better smartphone cameras. Researchers at Stanford University have created a new approach that allows standard image sensors to see light in three dimensions. These common cameras could soon be used to measure the distance to objects.

Measuring distance between objects with light is now possible only with specialized and expensive lidar – short for “light detection and ranging” – systems. But the Stanford scientists wrote in a recent paper that they came up with a solution that relies on a phenomenon known as acoustic resonance. The team built a simple acoustic modulator using a thin wafer of lithium niobate – a transparent crystal that is highly desirable for its electrical, acoustic, and optical properties – coated with two transparent electrodes.

“Existing lidar systems are big and bulky, but someday, if you want lidar capabilities in millions of autonomous drones or in lightweight robotic vehicles, you’re going to want them to be very small, very energy efficient, and offering high performance,” Okan Atalar, the first author on the new paper. said in a news release.

Editors' Recommendations

Nomad’s hefty new MagSafe charger will stay exactly where you put it
The Nomad Stand One in carbide.

Tired of your wireless charger making its own way around the desk or bedside table? The way lightweight pads can slip around, seemingly with a will of their own, can be frustrating. That’s why you need Nomad’s new Stand One.

This metal and glass MagSafe charger weighs 613 grams, or just over 1 pound. It’s unlikely to shift about without quite a lot of encouragement. It's likely a bit overkill, but is there anything really wrong with that?

Read more
Apple Watch Series 9: the 6 biggest things we want to see
The Apple Watch Ultra with the Apple Watch Series 8 and Watch SE 2.

The Apple Watch Series 8 was a bit of a boring release for Apple’s wearable, as it wasn’t a huge upgrade over the Apple Watch Series 7; Apple seemed to spend more energy focusing on the Apple Watch Ultra instead. The only real upgrades for the Series 8 were the newer-generation S8 chip and a new body temperature sensor, though the use cases for that are pretty limited. But if you didn’t have a Series 7, then the Apple Watch Series 8 was still a great upgrade for those coming from older models.

We’re still a few months away from Apple revealing the next generation of Apple Watch with a Series 9 model, which is most likely coming sometime in the fall, along with the iPhone 15. But until then, here’s what I’m hoping Apple will put in the Apple Watch Series 9 when it finally comes out.
Nonintrusive blood glucose monitoring

Read more
iPhone 15: release date and price predictions, leaks, rumors, and more
iPhone 15 render by 4RMD

As great as the iPhone 14 and iPhone 14 Pro are, they're both already a few months old at this point, and the rumors about the iPhone 15 are well underway. We still have several months before the iPhone 15 models drop, though, as Apple usually makes iPhone announcements in the fall. In other words, there's still a lot of time for rumors to circulate around the internet.

We're keeping all of the reports and rumors of the iPhone 15 here in a single place for your convenience, but do remember to keep in mind that these are all still just speculation. Nothing is final until Apple confirms it during an official announcement. Still, a lot of the rumors give us an idea of what to expect each year, which is unfortunate if you like surprises. Here's everything we know of the iPhone 15 so far!
iPhone 15: models

Read more