what's wrong
root@linaro-alip:/userdata/zxj/VoxCPM_0.5B_RKNN2# python onnx_infer-rknn2.py --onnx-dir . --tokenizer-dir . --base-hf-dir . --residual-hf-dir . --text "哇, 这个模型居然在RK3588这个辣鸡SoC上也能完美运行!" --prompt-audio basic_ref_zh.wav --prompt-text "对，这就是我，万人敬仰的太乙真人。" --output rknn_output.wav --cfg-value 2.0 --inference-timesteps 10 --seed 1234
I rkllm: rkllm-runtime version: 1.2.3, rknpu driver version: 0.9.8, platform: RK3588
I rkllm: loading rkllm model from ./base_lm.rkllm
I rkllm: rkllm-toolkit version: 1.2.3, max_context_limit: 4096, npu_core_num: 1, target_platform: RK3588, model_dtype: FP16
I rkllm: Enabled cpus: [4, 5, 6, 7]
I rkllm: Enabled cpus num: 4
I rkllm: rkllm-runtime version: 1.2.3, rknpu driver version: 0.9.8, platform: RK3588
I rkllm: loading rkllm model from ./residual_lm.rkllm
I rkllm: rkllm-toolkit version: 1.2.2, max_context_limit: 4096, npu_core_num: 3, target_platform: RK3588, model_dtype: FP16
I rkllm: Enabled cpus: [4, 5, 6, 7]
I rkllm: Enabled cpus num: 4
/userdata/zxj/VoxCPM_0.5B_RKNN2/onnx_infer-rknn2.py:558: UserWarning: RKNN API version 2.3.2 (429f97ae6b@2025-04-09T09:09:27) is likely outdated; behavior may be unstable. Recommended minimum version is 2.4.1.
main()
[time] vae_encode_0: 1751.04 ms
[time] vae_encode_38400: 1668.38 ms
[time] vae_encode_76800: 1663.09 ms
E RKNN: [03:14:03.250] Meet unsupported src layout for normalize: NCHW, only support NHWC src layout!
E RKNN: [03:14:03.250] rknn_inputs_set, normalize error(-1) index=0
Try to upgrade the RKNPU2 runtime library (librknnrt.so) to 2.4.1b0 from https://console.zbox.filez.com/l/I00fc3 (fetch code: rknn) and test again
Thank you very much！
Now, how can i install it by this file 2.4.1b0.tgz
There is non package support aarch64，they only support Linux
You don't need to install these python packages. Find the librknnrt.so in rknpu2_runtime_xxxx_xx_xx.tar.gz/runtime/Linux/librknn_api/aarch64/librknnrt.so , and use this new version to replace the one currently installed in your system (typically /usr/lib/librknnrt.so , you can find it by whereis librknnrt.so)
Thank you very much！I solved it