Skip to main content

Sony wants to make cameras smarter with an onboard A.I. chip

Over the last few years, tech companies such as Google have turned to machine learning to push the limits of what a camera can do without bulky hardware. Now, Sony, that dominates more than half of the image processing market, is throwing its hat in the ring with two new sensors that come equipped with an onboard A.I. chip.

Officially called the IMX500 and IMX501, Sony says these new 12.3-megapixel sensors tackle several obstacles of how artificial intelligence is today applied to camera data. Since they have a built-in chip for the purpose, the Japan-based manufacturer claims its sensors eliminate the “need for high-performance processors or external memory” and can deliver results much quicker compared to when cameras have to transfer the metadata first to an external system.

Sony’s latest sensors run the image signals they capture natively on a separate logic chip and only beam out the extracted metadata. As the image information never itself leaves the sensor, Sony is also promising a more secure and private experience.

“These products expand the opportunities to develop A.I.-equipped cameras, enabling a diverse range of applications in the retail and industrial equipment industries and contributing to building optimal systems that link with the cloud,” the company wrote in a blog post.

However, you won’t find this technology on consumer products such as phones and handheld cameras just yet. Instead, these new sensors, for now, will be restricted for commercial purposes such as surveillance cameras and smart retail spaces that demand complex computer vision architectures such as Amazon Go.

Since Sony’s sensors can process data in real time, they won’t have to transfer every piece of footage the camera records. So for instance, at a cashier-less supermarket, the camera will only upload a particular aisle’s videos when there’s some activity instead of constantly transferring it for another A.I. computer to process — resulting in a dramatic conservation in data output and cloud servers.

Sony told Engadget that the sensors can perform “light machine learning tasks” like keeping track of the number of customers entering a store or identifying objects. Therefore, they won’t replace existing camera modules just yet. But it’s clear Sony will push ahead with more powerful and capable of A.I. sensors in the future. Sony says it has already sent sample kits to partners, so devices powered by them won’t most likely arrive before 2021.

Editors' Recommendations

Shubham Agarwal
Shubham Agarwal is a freelance technology journalist from Ahmedabad, India. His work has previously appeared in Firstpost…
The Galaxy S21 Ultra’s great camera doesn’t make life easy for the iPhone 13 Pro
The iPhone 13 Pro and Galaxy S21 Ultra held in hand.

The Galaxy S21 Ultra has the best camera Samsung has made yet, and it remains one of our favorite camera phones. Its biggest rival for the crown of “best camera on a smartphone,” the Apple iPhone 12 Pro, has now been replaced in the range by the iPhone 13 Pro, making it essential to put the two cameras up against each other.

Samsung’s hard work paid off on the Galaxy S21 Ultra, but will it now have to play catch-up to Apple’s newer iPhone? The 13 Pro’s camera has generated plenty of hype, but as you'll see, the Galaxy S21 Ultra is not only still a winner, it has the new iPhone beaten in several important areas.
The cameras and the test
All photos taken for this comparison were shot over the course of a single day, with all using the standard Photo mode on both phones, and without any editing afterward. Do be aware the photos have been resized to make them suitable for viewing online. Before they were resized, the photos were compared on a color-calibrated monitor.

Read more
Nvidia’s latest A.I. results prove that ARM is ready for the data center
Jensen Huang at GTX 2020.

Nvidia just published its latest MLPerf benchmark results, and they have are some big implications for the future of computing. In addition to maintaining a lead over other A.I. hardware -- which Nvidia has claimed for the last three batches of results -- the company showcased the power of ARM-based systems in the data center, with results nearly matching traditional x86 systems.

In the six tests MLPerf includes, ARM-based systems came within a few percentage points of x86 systems, with both using Nvidia A100 A.I. graphics cards. In one of the tests, the ARM-based system actually beat the x86 one, showcasing the advancements made in deploying different instruction sets in A.I. applications.

Read more
Apple unveils iPhone 13 with new chip, smaller notch, and better cameras
New iPhone 13 Colors: Starlight, Blue, & Pink.

Apple has revealed the latest edition to its iPhone range, the iPhone 13. It comes with a new camera arrangement, a more powerful chip, a thinner notch, and more.

Since its debut in the iPhone X, the notch -- which houses the phone’s Face ID system and front-facing camera -- has been divisive. Apple seems to have listened to dissenters and has shrunk the notch’s width by 20%, making it less intrusive in use.

Read more