Apple Patents Cutting-Edge Camera Sensor Mimicking Human Vision Dynamics

Apple has recently obtained a patent for an innovative type of image sensor designed for cameras, enabling the capture of photos and videos with a dynamic range that closely resembles human vision.

The patent, titled «Image Sensor with Stacked Pixels Featuring High Dynamic Range and Low Noise,» describes an advanced architecture that integrates stacked silicon, multiple light-capturing layers, and noise suppression mechanisms on the chip, achieving up to 20 stops of dynamic range.

For comparison, the dynamic range of the human eye is estimated to be around 20 to 30 stops, depending on pupil adjustments and light processing. Currently, most smartphone cameras operate within a range of 10 to 13 stops. If Apple’s proposed sensor fulfills its promises, it would not only surpass the capabilities of existing iPhones but also compete with many professional cinema cameras, including the ARRI ALEXA 35.

The patent outlines a two-layer design for the stacked sensor. The upper layer, known as the sensing crystal, consists of photodetectors that capture light, while the lower layer, the logic crystal, handles processing tasks such as noise reduction and exposure control.

Apple currently utilizes sensors manufactured by Sony across its entire iPhone lineup. Although these sensors also feature a two-layer structure, Apple’s version includes several proprietary functions and occupies less space.

A critical component of the sensor’s design is a system called the Lateral Overflow Integration Capacitor (LOFIC). This allows each pixel to retain varying amounts of light depending on the brightness level of the scene captured in a single image. As a result, the sensor can manage significant differences in lighting, such as when a person stands in front of a bright window, without losing detail in shadows or highlights.

Another aspect of the design focuses on minimizing noise and graininess in images. Each pixel is equipped with an integrated memory circuit that measures and mitigates thermal noise in real time, taking place on the chip before the image is stored or edited by software.

In a separate development, Apple has previously secured a patent for an iPhone featuring three new action buttons on the side. The first is a standard action button, similar to those found on the iPhone 15 Pro and 16 Pro, while the other two will replace the volume and lock buttons. By default, these buttons will function as their respective controls, but users will have the option to assign custom commands as well.