SPRAD86A March   2023  – May 2024 AM62A3 , AM62A3-Q1 , AM62A7 , AM62A7-Q1 , AM68A , AM69A

 

  1.   1
  2.   Abstract
  3.   Trademarks
  4. 1 Introduction
  5. 2 Tuning Overview
  6. 3 Hardware Requirement
  7. 4 Software Requirement
    1. 4.1 Processor SDK Linux
    2. 4.2 TI's Reference Imaging Software
    3. 4.3 ISP Tuning Tool
  8. 5 Sensor Software Integration
    1. 5.1 Overview of Image Pipeline Software Architecture
    2. 5.2 Adding Sensor Driver to SDK
    3. 5.3 Updating TIOVX Modules
      1. 5.3.1 Source Code Change
      2. 5.3.2 Rebuild Modules
    4. 5.4 Update GStreamer Plug-in for VISS
      1. 5.4.1 Update VISS Plug-in Property
      2. 5.4.2 Add Exposure Setting for 2A Algorithm
        1. 5.4.2.1 Gain
        2. 5.4.2.2 Exposure Time
        3. 5.4.2.3 Other Parameters
      3. 5.4.3 Rebuild Plug-ins
      4. 5.4.4 Verify New Sensor in GStreamer Plug-in
  9. 6 Tuning Procedure
    1. 6.1 Verify Functional Operation of Camera Capturing
    2. 6.2 Enable Camera Streaming With Initial VPAC Configuration
      1. 6.2.1 Generate Configuration Files
      2. 6.2.2 Generate DCC Binary Files
      3. 6.2.3 Stream Video With the Initial Configuration
    3. 6.3 Adjust Camera Mounting
  10. 7 Perform Basic Tuning
    1. 7.1 Launch the Tuning Tool and Create a Project
    2. 7.2 Tuning Order
    3. 7.3 Black Level Subtraction
    4. 7.4 Hardware 3A (H3A)
    5. 7.5 PCID
    6. 7.6 Auto White Balance (AWB)
      1. 7.6.1 Capture Raw Images for Different Lighting Conditions
      2. 7.6.2 Tuning AWB
    7. 7.7 Color Correction
  11. 8 Perform Fine Tuning
    1. 8.1 Edge Enhancement (EE)
    2. 8.2 Noise Filter 4 (NSF4)
  12. 9 Live Tuning
    1. 9.1 Requirements
    2. 9.2 Supported Features
      1. 9.2.1 RAW Capture
      2. 9.2.2 YUV Capture
      3. 9.2.3 Live DCC Update
      4. 9.2.4 Exposure Control
      5. 9.2.5 White Balance Control
      6. 9.2.6 Sensor Register Read/Write
  13. 10Summary
  14. 11Revision History

7.2 Tuning Order

The AM6xA ISP (VPAC) consists of multiple functional blocks. Raw images are processed by these blocks one after another. The tuning tool allows tuning of the ISP blocks in independent groups, with each group containing one or more ISP blocks. The tuning groups are referred as plug-ins, as shown in the tuning tool menu Plug-ins:

DCC Tuning Tool Plug-ins Figure 7-3 DCC Tuning Tool Plug-ins
Note: Each plug-in has a tuning guide, available from the Help → Documentation drop-down menu. Reference these guides during the tuning.

In general, tune these plug-ins in the same order of ISP blocks when processing the raw image. Below is a recommended tuning order:

  1. Black Level Subtraction (BLC): Data pedestal (sensor black level) is typically specified by the sensor driver and can be calculated here for verification.
  2. H3A: Hardware 3A (Auto exposure, Auto focus, Auto white balance) statistics
  3. PCID: Pattern Conversion and IR Demosaicing (only for RGB+IR sensors)
  4. AWB: Auto White Balance
  5. Color Correction
  6. EE: Edge Enhancement
  7. Noise Filter 4
  8. Mesh LDC: Lens Distortion Correction
  9. CFAI + WDR: Color Filter Array Interpolation + Wide Dynamic Range
  10. LSC: Lens Shading Correction

There is a slight difference in tuning RGB-only sensors and RGB-IR sensors:

  • For RGB-only sensors: BLC, H3A, AWB, CCM, NSF4, EE, and so forth.
  • For RGB-IR sensors: H3A, PCID, AWB, CCM, NSF4, EE, and so forth.

After tuning each plug-in, a new set of XML files for VPAC configuration can be generated. These new XML files can replace those generated from the initial configuration to gradually improve the image quality.

In this application note, the OX05B1S sensor is used to illustrate the tuning of PCID, and the IMX219 sensor is used for illustrating the tuning of the rest plug-ins including black level, AWB, color correction, and so forth. More details about tuning are available in the plug-in guides from the Help menu of the tuning tool. Other versions of ISP tuning tool from TI 3rd parties follow roughly the same procedure.