nemotron-ocr-v2-coreml / benchmarks /recognizer_features_int8.md
mweinbach1's picture
Upload full CoreML OCR neural pipeline
ed77b73 verified

Benchmark — model.mlpackage

  • input regions shape = [128, 128, 8, 32]
compute unit mean median p95 p99 min max stdev
ALL 4.87 ms 4.73 ms 5.85 ms 6.02 ms 4.24 ms 6.06 ms 0.56 ms
CPU_AND_GPU 4.60 ms 4.53 ms 5.01 ms 5.11 ms 4.26 ms 5.13 ms 0.26 ms
CPU_AND_NE 11.02 ms 11.04 ms 11.18 ms 11.21 ms 10.85 ms 11.21 ms 0.11 ms
CPU_ONLY 47.68 ms 47.58 ms 48.85 ms 49.02 ms 46.46 ms 49.06 ms 0.75 ms

Fastest: CPU_AND_GPU at 4.53 ms median.