SDAA429A June 2026 – October 2026 MSPM0G5187
The Edge AI model can be deployed to hardware via TI Neural Network Compiler, targeting either the dedicated hardware NPU or the host CPU. The TinyEngine NPU is a dedicated hardware accelerator specifically designed to execute neural network computations with high efficiency, delivering significantly reduced inference latency and energy compared to a general-purpose CPU.
To facilitate performance evaluation, the MSPM0 SDK provides both NPU and CPU implementation examples for user benchmarking, refers to:
Table 7-9 summarizes the performance comparison between the NPU-based and CPU-based Edge AI designs for the digit recognition application.
| Performance Metric | NPU-Based Design | CPU-Based Design |
|---|---|---|
| Accuracy | Approximately 99% | Approximately 99% |
| Flash Usage | 73KB | 68KB |
| RAM Usage | 10.9KB | 8.1KB |
| Inference Latency | 6.05ms | 89.81ms |
| Inference Energy (AVG) | 170.38uJ | 2,447.45uJ |
The NPU-based design achieves approximately 15 times lower inference latency compared to the CPU-based implementation and effectively reduces the energy consumption per inference by approximately 96%, making it a highly efficient choice for power-sensitive edge applications.