Samsung Camera Sensors Infused with AI to Emulate Human Vision

Samsung have kick-started 2024 by announcing the follow-up of their upcoming Galaxy Unpacked 2024 on January 17th. The Unpacked reveals their AI and tech developments on the Galaxy S24 Series and more, but before the details are officially revealed on that day, you might want to take a sneak peek of the possible contents available, which you can discover in this article.

Samsung seems to mark this year as one of their years in AI development, as besides the Samsung Unpacked, they’re pushing the boundaries further on their Samsung camera sensors. They announced that have a plan to infuse AI in their Samsung camera sensors to emulate vision, fortifying their cameras to another level.

Samsung Camera Sensors with AI: Humanoid Sensors

Dubbed “Humanoid Sensors” internally, this ambitious initiative strives to develop camera sensors that not only capture images but also emulate human sensory capabilities.

About the Humanoid Sensors

In contrast to conventional sensors dependent on the device’s CPU for image processing, Humanoid Sensors feature a dedicated chip with integrated AI capabilities within the sensor itself. This strategic decision is positioned to elevate image quality, diminish latency, and decrease power consumption, fostering a photography experience that is smoother and more efficient. Moreover, the objective is to develop sensors with the ability to emulate human senses, potentially achieving a resolution of 500 to 600 megapixels by the year 2027.

You Might Be Interested In: Stellantis and Samsung SDI Plan U.S. Battery Plant

Samsung’s Previous Effort on Samsung Camera Sensors

ISOCELL GWB: A Samsung Camera Sensor Inspired by Human Vision

Samsung have recently introduced the ISOCELL GWB, positioned as the inaugural smartphone sensor designed to emulate the human eye. Featuring a distinctive RGBW colour filter, this 64-megapixel sensor incorporates white pixels alongside the conventional red, green, and blue pixels. The outcome is a sensor that replicates the human eye’s capacity to capture additional light, proficiently eliminating noise and generating images that closely resemble our visual perception.

ISOCELL Zoom Anyplace: Revolutionising Smartphone Videography

In a move to grant users greater creative control in smartphone videography, Samsung introduced the ISOCELL Zoom Anyplace feature. Tailored for the 200-megapixel image sensor, this inventive feature enables users to designate a subject, prompting the camera to autonomously track and film it. Powered by Qualcomm‘s AI engine, real-time tracking is assured, preventing swift subjects from moving out of frame and minimising screen shake.

The true innovation lies in the capacity to concurrently capture both the full field of view and zoomed-in segments in high resolution. This eradicates the previous trade-off between full-screen and zoomed-in video quality, offering users the flexibility to record a scene from various perspectives. The in-sensor zoom by Tetra2pixel further amplifies this capability, enabling users to zoom freely without compromising image resolution.

E2E AI Remosaic: Enhancing Image Capture on Samsung Camera Sensors

Samsung’s End-to-End (E2E) AI Remosaic for image capture complements the video-centric ISOCELL Zoom Anyplace. The conventional image processing workflow includes sequential steps such as raw data output, remosaic, Image Signal Processing (ISP), and JPEG output. However, E2E AI Remosaic disrupts this sequence by allowing remosaic and ISP to occur simultaneously, cutting remosaic latency by up to half.

This breakthrough results in significantly faster image processing times, leading to quicker photo capture and improved image quality. Users can anticipate photos with richer details and colours, experiencing reduced data loss due to latency. Samsung’s dedication to enhancing the user experience is evident in these technological advancements, representing a substantial leap forward from the 2021 release of the 200MP image sensor.

Also Read: It’s a New Change: From Samsung Game Launcher App to Samsung Gaming Hub, Renaming and Enhancements in 2023

Samsung’s Ongoing Innovation on Samsung Camera Sensors

ISOCELL Zoom Anyplace and E2E AI Remosaic mark significant milestones in Samsung’s journey of developing Samsung camera sensors, demonstrating the company’s enduring commitment to long-term innovation. These solutions, conceived from a vision to revolutionise video and photo experiences, play crucial roles in Samsung’s overarching strategy to consistently enhance user interactions with their ultra-high resolution ISOCELL image sensor.

Making the Unseen Seen: Advancements in On-Sensor AI by Samsung

“Future Samsung camera sensors could capture the invisible” https://t.co/dM6EwMsTvd

— 🇺🇸surveillancesurvivors.info🎯 (@shsa_usa) January 1, 2024

Samsung’s forward-looking strategy involves capturing previously ‘Invisible’ elements by 2027, a goal that currently holds an air of mystery. The envisioned capabilities are speculated to resemble those found in FLIR thermal cameras or technologies that enable capturing imperceptible information without the need for specialised sensors. This commitment underscores Samsung’s determination to expand the horizons of Samsung camera sensor capabilities.

Also Read: Samsung and Xiaomi Poke Fun at Apple’s iPhone 15

The Quest for Supremacy: AI-Powered Advancements in Camera Sensor Technology

Samsung, currently holding the second-largest share in the smartphone camera sensor market at 29%, seek to utilise AI as a means to surpass the current leader, Sony. Emphasising ‘On-Sensor AI’, Samsung aim to detect imperceptible objects and enhance sensor capabilities beyond traditional megapixel limits. This strategic initiative aligns with Samsung’s vision to pioneer the ‘Proactive AI’ era, incorporating generative AI, long-range communication solutions, and high-performance algorithms.

Looking forward, Samsung’s strides in AI-powered camera sensors underscore a dedication to pushing the boundaries of smartphone photography. Users can expect ongoing breakthroughs that redefine the essence of capturing the moment, as Samsung persistently integrates cutting-edge technology into our daily lives.

Final Say

In summary, the incorporation of AI into Samsung camera sensors marks the dawn of a new epoch in smartphone photography. The synergy of Humanoid Sensors, ISOCELL GWB, ISOCELL Zoom Anyplace, and E2E AI Remosaic reflects Samsung‘s unwavering dedication to innovation. The intersection of AI and camera sensors introduces intriguing prospects for the future of photography and imaging technology.

As end-users, we can anticipate capturing life’s subtleties with unparalleled clarity, creativity, and a touch of futuristic enchantment, all conveniently within our pockets. It marks a breakthrough not only in smartphone photography but also in their own.