SPRADP7A February   2025  – March 2025 AM62A3 , AM62A3-Q1 , AM62A7 , AM62A7-Q1 , AM67A , TDA4AEN-Q1

 

  1.   1
  2.   Abstract
  3.   Trademarks
  4. 1Introduction
  5. 2Building Blocks of an RGB-IR Vision Pipeline
    1. 2.1 CSI Receiver
    2. 2.2 Image Signal Processor
    3. 2.3 Video Processing Unit
    4. 2.4 TI Deep Learning Acceleration
    5. 2.5 GStreamer and TIOVX Frameworks
  6. 3Performance Considerations and Benchmarking Tools
  7. 4Reference Design
    1. 4.1 Camera Module
    2. 4.2 Sensor Driver
    3. 4.3 CSI-2 Rx Driver
    4. 4.4 Image Processing
    5. 4.5 Deep Learning for Driver and Occupancy Monitoring
    6. 4.6 Reference Code and Applications
  8. 5Application Examples and Benchmarking
    1. 5.1 Application 1: Single-stream Capture and Visualization with GST
    2. 5.2 Application 2: Dual-stream Capture and Visualization with GST and TIOVX Frameworks
    3. 5.3 Application 3: Representative OMS-DMS + Video Telephony Pipeline in GStreamer
  9. 6Summary
  10. 7References
  11. 8Revision History

4.2 Sensor Driver

The driver for the OX05B1S sensor is provided through the Processor SDK Linux (or EdgeAI SDK) for AM62A, located in source file drivers/media/i2c/ox05b1s.c within the linux-kernel. The driver configures the sensor to operate in two modes:

  • Mode A (virtual channel 0): This mode can be synchronized with turning on an external IR illuminator, allowing the sensor to capture and send IR-dominant streams.
  • Mode B (virtual channel 1): This mode can be synchronized with turning off the external IR illuminator, enabling the sensor to capture and send RGB-dominant streams.

These two modes can alternate, with each mode running for a different number of frames to achieve the desired frame rate for each stream. For instance, both streams can run at 30 fps, or one stream can run at 15 fps while the other runs at 45 fps.