Skip to main content
  1. Home
  2. Mobile
  3. Features

New A.I. system could upgrade smartphone cameras

Sascha Brodsky
By

Your smartphone camera might soon be getting a big upgrade thanks to the power of artificial intelligence.

A startup is using new technology to pack the power of a DSLR into phones. Glass Imaging wants to boost smartphone camera quality using deep neural networks and a new kind of sensor.

Recommended Videos

“By rethinking the optical system from the ground up to be tailor-made for smartphones, we managed to fit huge CMOS sensors that collect around 9x more light than traditional designs,” Ziv Attar, the company’s CEO, said in a news release. “Our state-of-the-art A.I. algorithms seamlessly correct all the distortions and aberrations, and as a result, smartphone image quality is radically increased, up 10x.”

Smarter lenses

A hand holds the DISH Celero 5G smartphone, with a close-up of the camera module.
Celero 5G Image used with permission by copyright holder

Attar explained in an interview with TechCrunch that up until recently, smartphone companies tried to improve image quality by using larger sensors and wider lenses. However, even with noise-reduction algorithms, the resulting imagery using this method ends up looking “weird and fake.”

To solve the image quality problem, Glass plans to put a larger lens inside a smartphone, but today’s ultraslim phones don’t have enough room to fit in the bigger optics. So, Glass instead intends to change the aspect ratio of the smartphone sensor. The company’s proposed method is to leverage the concepts behind anamorphic lenses. Anamorphic is a filmmaking technique of shooting for widescreen on 35mm film or sensors. The lenses fit the larger field of view to fit on a sensor, and then the footage is de-squeezed in postproduction to create a wider aspect ratio.

Mario Pérez, a professional photographer, said in an interview that anamorphic lenses had been used for years mainly for cinematic productions. But today. photography and videography enthusiasts have access to a wide array of anamorphic lenses.

“The main benefit these lenses bring is the ability to fit a wider angle of view than regular lenses, all within a small, average camera sensor, without any visible distortion (provided the video is duly processed later on),” he added.

Pérez said that it’s become relatively easy to get a phone with a regular lens and then attach a third-party anamorphic lens to it, which will get you many of the typical features a cinematic anamorphic lens offers: Wider angle of view, intense “bokeh” effect, and flares on light sources, among other benefits.

“Smartphone industry is evolving at an incredibly rapid pace,” Pérez said. “Videographers and photographers are shifting towards working with smartphone cameras as these grow in specs and performance. I wouldn’t be surprised to see smartphone brands equipping smartphone cameras with anamorphic lenses at some point soon, very much in accordance with how Apple added Cinematic Mode (Focus Shift) to iPhone 13 Pr, for instance.”

When it comes to smartphone camera innovations, Pérez said that variable focal length is another bold feature that will make a huge difference when it becomes a reality. Currently, the only way smartphone cameras can offer different focal lengths is by putting together two or more lenses with different focal lengths. The only exceptions to that are the Sony Xperia 1 III and and Xperia 5 III, both of which have moving lenses in the periscope telephoto module that provide different focal lengths. But it’s certainly a rarity.

“The day a smartphone brand will offer us, photographers and videographers, the ability to shoot with our smartphone camera at different focal lengths, all from one single lens, that day will mark the beginning of a new era in the industry of visual content creation,” Pérez said.

New takes on the camera lens

image of a city street with depth information displayed as colors.

Glass isn’t the only company trying to use new techniques to make better smartphone cameras. Researchers at Stanford University have created a new approach that allows standard image sensors to see light in three dimensions. These common cameras could soon be used to measure the distance to objects.

Measuring distance between objects with light is now possible only with specialized and expensive lidar – short for “light detection and ranging” – systems. But the Stanford scientists wrote in a recent paper that they came up with a solution that relies on a phenomenon known as acoustic resonance. The team built a simple acoustic modulator using a thin wafer of lithium niobate – a transparent crystal that is highly desirable for its electrical, acoustic, and optical properties – coated with two transparent electrodes.

“Existing lidar systems are big and bulky, but someday, if you want lidar capabilities in millions of autonomous drones or in lightweight robotic vehicles, you’re going to want them to be very small, very energy efficient, and offering high performance,” Okan Atalar, the first author on the new paper. said in a news release.

Editors' Recommendations

Topics
Sascha Brodsky
Sascha Brodsky
Mobile Writer
Sascha Brodsky is a writer who focuses on consumer technologies and privacy issues for a broad range of outlets. He’s been…
Only the most expensive iPhone 15 will get a new periscope camera
iPhone 13 Pro review.

Apple is expected to upgrade the iPhone's camera system with a fancy new periscope lens, according to a new report. However, this update will be exclusive to the company’s flagship device of 2023, the iPhone 15 Pro Max. The news comes from reliable Apple analyst Ming-Chi Kuo. Kuo had previously claimed that the technology would be available on all the Pro models, with the recent clarification limiting it to the 'Max' model.

Android phones have been leveraging the capabilities of the periscope camera for some time now. The Huawei P30 Pro was the first device to introduce the tech in 2019. If you are unaware, a periscope lens offers better zoom capabilities than a typical telephoto lens. Thus multiple phone manufacturers have started opting for this tech. Apple is one such manufacturer that plans to improve its zoom capabilities by utilizing this tech. You'll see it more on Android phones than iPhones though. The current-gen iPhone 13 Pro models are capable of 3x optical zoom and 15x digital zoom. On the other hand, backed by periscope lenses, Samsung's Galaxy S22 Ultra offers 10x optical zoom and 100x digital zoom while Vivo's X80 Pro has 5x optical zoom and 60x digital zoom.

Read more
Samsung’s new 200MP smartphone camera looks incredible
samsung new 200 megapixel phone camera sensor isocell hp3

Samsung has a new smartphone camera sensor in the pipeline, one that offers a resolution of 200 megapixels with some fresh tricks in tow. Officially called the ISOCELL HP3, this is not Samsung’s first 200MP camera sensor, but it has the smallest pixels that the company has fitted on a sensor to date. The company has already started sending out samples to vendors and aims to begin mass production later this year.

Interestingly, Samsung’s first-generation ISOCELL HP1 200-megapixel camera sensor is yet to appear on a commercially available phone, but it appears that the company wants to keep the momentum of innovation intact. The key improvement that arrives with the ISOCELL HP3 is that it features 0.56-micron pixels, allowing Samsung to produce a smaller 1/1.14-inch camera sensor format, while its predecessor offered 0.64-micron pixels that paved the way for a 1/1.22–inch sensor profile.

Read more
New 3D smartphone technology could change photography, experts say
omnivision latest sensor enhances sensitivity low light smartphone camera

Your next smartphone could have a camera that sees in three dimensions, opening up a new range of possibilities for apps ranging from fitness to photography.

Researchers at Stanford University have created a novel approach that allows standard image sensors to see light in 3D. The technique would allow cameras to measure the distance to objects and make three-dimensional imaging widely available in smartphones.

Read more