Commit History

use qwen3 1.7b as optional model
2fb2f79

Luigi commited on

use tiiuae/Falcon-H1-1.5B-Deep-Instruct-GGUF:Q4_0 as model example
81e6259

Luigi commited on

use default n_batch & n_ubatch
6add551

Luigi commited on

default to qwen3 0.6b
83a3f98

Luigi commited on

add -c option to force cpu only
c16840d

Luigi commited on

use ernie 4.5 0.3b as default model
01dc9b6

Luigi commited on

decrease batch number to save mem.
16c9738

Luigi commited on

simplify script
fba2074

Luigi commited on

add CLI interface
2bc625f

Luigi commited on

adjust output file name to summary.txt
2226736

Luigi commited on

output summary unquely in zh-TW
0745d93

Luigi commited on

switch from tiny falcon 100m to ernie 4.5 21b a3b
f8cb070

Luigi commited on

cleanup: remove unused non-streaming summarize_transcript function
d59740a

Luigi commited on

refactor: fix streaming summary bug and simplify to streaming-only output
d4fd1c3

Luigi commited on

summarization script
7ac9e1f

Luigi commited on

add llama-cpp-python JamePeng's fork
b4e6021

Luigi commited on