SBOS790A April 2017 – March 2025 INA233
PRODUCTION DATA
The m, b, and R coefficients are fixed for bus voltage measurements returned by the READ_VIN and READ_VOUT and are available from Table 6-1.
For current and power measurements, the value for the m and R coefficients must be calculated. For current measurements returned by the READ_IIN and READ_IOUT commands, the value for m is calculated by inverting the Current_LSB used to set the MFR_CALIBRATION register and shifting the decimal location if needed to minimize rounding errors. In this example, using the Current_LSB of 1 mA/bit, the value of m is calculated to be 1000. Shifting the decimal location does not obtain higher accuracy because the value for m is a whole number. The value for R in this example is 0 because the decimal location for the value of m does not need shifting.
The POWER_LSB value is 25 times the value of the CURRENT_LSB, therefore, the value for m is reduced by a factor of 25. For this example, the value for the m power coefficient 1000 / 25 or 40. For this case, the R coefficient is also 0 because m is a whole number. If m is not a whole number, then shifting the decimal place is advantageous to reduce rounding errors while keeping the value between –32768 and 32767. Decimal shifts to the right result in negative values for R and shifts to the left result in positive values; the number of shifts is the absolute value of R.
The value of 0 can be used for b for both current and power measurements with very little loss in accuracy because the offset for power and current measurements is very low. The m, b, and R coefficients are fixed for bus voltage measurements returned by the READ_VIN and READ_VOUT and are available from Table 6-1.