Function Introduction

The ISP processor provides algorithms and real-time image information feedback. Since some parameters of the algorithms are initially uncertain, the algorithms must work with adaptive control methods in firmware. The adaptive control method obtains the image information, recalculates related parameter values such as the exposure time and gain, and estimates the parameter values required by the next frame to control the sensor, and ISP logic. This ensures that the image quality is automatically adjusted.

The following diagram shows the operating mode of the ISP. The light signals onto the photosensitive area of the sensor. After photoelectric conversion, the sensor transmits Bayer raw images to the ISP. The ISP processes the images based on related algorithms and outputs the images in the Bayer/YUV spatial domain to the firmware and display module. During this process, the ISP controls the sensor by using the firmware and implementing the functions including Automatic Exposure (AE), and Automatic White Balance (AWB). The firmware is driven by the interrupts of the ISP module. The StarFive Tuning Tools adjust the quality of the online images of the ISP over the Ethernet port.

Figure 1. ISP Operation Mode