SPRAD86A March   2023  – May 2024 AM62A3 , AM62A3-Q1 , AM62A7 , AM62A7-Q1 , AM68A , AM69A

 

  1.   1
  2.   Abstract
  3.   Trademarks
  4. 1 Introduction
  5. 2 Tuning Overview
  6. 3 Hardware Requirement
  7. 4 Software Requirement
    1. 4.1 Processor SDK Linux
    2. 4.2 TI's Reference Imaging Software
    3. 4.3 ISP Tuning Tool
  8. 5 Sensor Software Integration
    1. 5.1 Overview of Image Pipeline Software Architecture
    2. 5.2 Adding Sensor Driver to SDK
    3. 5.3 Updating TIOVX Modules
      1. 5.3.1 Source Code Change
      2. 5.3.2 Rebuild Modules
    4. 5.4 Update GStreamer Plug-in for VISS
      1. 5.4.1 Update VISS Plug-in Property
      2. 5.4.2 Add Exposure Setting for 2A Algorithm
        1. 5.4.2.1 Gain
        2. 5.4.2.2 Exposure Time
        3. 5.4.2.3 Other Parameters
      3. 5.4.3 Rebuild Plug-ins
      4. 5.4.4 Verify New Sensor in GStreamer Plug-in
  9. 6 Tuning Procedure
    1. 6.1 Verify Functional Operation of Camera Capturing
    2. 6.2 Enable Camera Streaming With Initial VPAC Configuration
      1. 6.2.1 Generate Configuration Files
      2. 6.2.2 Generate DCC Binary Files
      3. 6.2.3 Stream Video With the Initial Configuration
    3. 6.3 Adjust Camera Mounting
  10. 7 Perform Basic Tuning
    1. 7.1 Launch the Tuning Tool and Create a Project
    2. 7.2 Tuning Order
    3. 7.3 Black Level Subtraction
    4. 7.4 Hardware 3A (H3A)
    5. 7.5 PCID
    6. 7.6 Auto White Balance (AWB)
      1. 7.6.1 Capture Raw Images for Different Lighting Conditions
      2. 7.6.2 Tuning AWB
    7. 7.7 Color Correction
  11. 8 Perform Fine Tuning
    1. 8.1 Edge Enhancement (EE)
    2. 8.2 Noise Filter 4 (NSF4)
  12. 9 Live Tuning
    1. 9.1 Requirements
    2. 9.2 Supported Features
      1. 9.2.1 RAW Capture
      2. 9.2.2 YUV Capture
      3. 9.2.3 Live DCC Update
      4. 9.2.4 Exposure Control
      5. 9.2.5 White Balance Control
      6. 9.2.6 Sensor Register Read/Write
  13. 10Summary
  14. 11Revision History

7.5 PCID

For RGB-IR sensors including the OX05B1S, tune the PCID plug-in first to generate the output 16-bit Bayer raw images that are used to calibrate AWB, CCM, NSF4, and so forth.

To tune PCID, raw images need to be captured at different lighting conditions. The specifics of these lighting conditions are outlined in Capture Raw Images for Different Lighting Conditions. Below is a summary of tuning this plug-in. For more details, refer to the PCID plug-in guide from the help menu.

  • Load an input 16-bit RAW image
  • Enter the proper parameter values
    • When choosing the Input and Output Format, verify that the Output Format matches with the configured pipeline. For example, OX05B1S has the color format of BGGR. The Input Format is set to "2:BGGIr", Output Format is set to "1: Interpolate R at IR positions and B at R locations" and the GStreamer pipeline must be configured as BGGR.
  • Process the plug-in to generate the output Bayer pattern with IR subtraction in 16 bit
  • Repeat this process for all lighting conditions
  • Export DCC profile binary to generate XML and binary files
Note:

When tuning RGB-IR sensors, set the black level to 0 while tuning the plug-ins that require the black level value since the black level has already been removed in IR subtraction.

PCID Tuning Figure 7-7 PCID Tuning

An example of GStreamer pipeline using the OX05B1S follows:

gst-launch-1.0 -v v4l2src device=/dev/video4 io-mode=dmabuf-import ! \ video/x-bayer, width=2592, height=1944, framerate=30/1, format=bggi10 ! queue ! \ tiovxisp sink_0::pool-size=4 sink_0::device=/dev/v4l-subdev2 sensor-name="SENSOR_OX05B1S" \ dcc-isp-file=/opt/imaging/ox05b1s/linear/dcc_viss.bin sink_0::dcc-2a-file=/opt/imaging/ox05b1s/linear/dcc_2a.bin format-msb=9 ! queue ! \ tiovxldc dcc-file=/opt/imaging/ox05b1s/linear/dcc_ldc.bin sensor-name=SENSOR_OX05B1S ! \ video/x-raw, format=NV12, width=2592, height=1944 ! queue ! \ tiovxmultiscaler src_0::pool-size=4 target=1 ! video/x-raw, format=NV12, width=1920, height=1080 ! queue ! \ tiperfoverlay location=perf_logs num-dumps=10 ! queue ! kmssink driver-name=tidss force-modesetting=true sync=false

Figure 7-8 and Figure 7-9 show an example of the captured RAW image completely unprocessed by the ISP and the output image of PCID tuning in Bayer pattern format.

RAW Image Input to PCIDFigure 7-8 RAW Image Input to PCID
PCID Output Image in Bayer PatternFigure 7-9 PCID Output Image in Bayer Pattern