Batch Code Example Higgs Audio V2
#25
by grimavatar - opened
Hi, I’m looking for a clear batch processing code example for using the v2 model.
Specifically, I’d like to understand how to:
- Run inference on multiple inputs in a single batch
- Structure the input data for batch generation
- Efficiently handle batching for performance (e.g., GPU utilization)
- Retrieve and separate outputs per input item
A minimal but complete example (preferably in Python) demonstrating batch usage would be really helpful. Thanks in advance!
grimavatar changed discussion status to closed