nvidia

/

parakeet-tdt-0.6b-v3

like 796

Follow

NVIDIA 55.2k

Hi all, for a ggml/GGUF pipeline in C++, as a fork of whisper.cpp, ICYI, see:

• Code: CrispStrobe/cohere-whisper.cpp (parakeet branch)
• Pre-converted GGUFs: cstr/parakeet-tdt-0.6b-v3-GGUF

💻 Quick Start

# Clone the specific branch and build
git clone -b parakeet https://github.com/CrispStrobe/cohere-whisper.cpp
cd cohere-whisper.cpp && cmake -B build -DCMAKE_BUILD_TYPE=Release
cmake --build build -j --target parakeet-main

# Download the Q4_K weights
huggingface-cli download cstr/parakeet-tdt-0.6b-v3-GGUF \
    parakeet-tdt-0.6b-v3-q4_k.gguf --local-dir .

# Run inference
./build/bin/parakeet-main -m parakeet-tdt-0.6b-v3-q4_k.gguf -f your.wav -t 8 -osrt

Bug reports are highly welcome! Particularly multilingual sanity checks beyond English, as I haven't had the chance to fully stress-test those yet. Would be nice to hear how it runs for you!