iiiiii123 commited on
Commit
ea99526
·
verified ·
1 Parent(s): d139077

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +41 -2
README.md CHANGED
@@ -1,6 +1,45 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
 
 
 
 
 
3
  base_model:
4
- - Qwen/Qwen2.5-Omni-7B
5
  - Qwen/Qwen2-Audio-7B-Instruct
6
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ language:
4
+ - en
5
+ - zh
6
+ library_name: transformers
7
+ tags:
8
+ - avbench
9
+ - audio-text
10
+ - video-text
11
+ - audio-video
12
  base_model:
 
13
  - Qwen/Qwen2-Audio-7B-Instruct
14
+ - Qwen/Qwen2.5-Omni-7B
15
+ ---
16
+
17
+ # AVBench Models
18
+
19
+ This repository hosts the evaluator models used in **AVBench**, a benchmark for text-to-audio-video generation quality and cross-modal consistency.
20
+
21
+ [![Hugging Face Dataset](https://img.shields.io/badge/HuggingFace-Dataset-FFD21E?logo=huggingface&logoColor=black)](https://huggingface.co/datasets/iiiiii123/AVBench)
22
+ [![AVBench Models](https://img.shields.io/badge/HuggingFace-AVBench__model-FFD21E?logo=huggingface&logoColor=black)](https://huggingface.co/iiiiii123/AVBench_model)
23
+
24
+ ## AVBench in brief
25
+
26
+ AVBench evaluates generated content on two splits:
27
+ - **Normal split**: common, easier samples.
28
+ - **Hard split**: challenging samples with stronger cross-modal requirements.
29
+
30
+ It covers cross-modal alignment (Audio-Text / Video-Text / Audio-Video) and generation quality dimensions.
31
+
32
+ Dataset link:
33
+ - https://huggingface.co/datasets/iiiiii123/AVBench
34
+
35
+ ## Model zoo used by AVBench
36
+
37
+ | Model | Use in AVBench | Trained / merged from |
38
+ |---|---|---|
39
+ | `Qwen2-Audio-7B-AudioTextMatching-Merged` | Audio-Text consistency scoring (AT) | `Qwen/Qwen2-Audio-7B-Instruct` |
40
+ | `Qwen2.5-Omni-7B-VideoTextMatching-Merged` | Video-Text consistency scoring (VT) | `Qwen/Qwen2.5-Omni-7B` |
41
+ | `Qwen2.5-Omni-7B-AudioVideoMatching-Merged` | Audio-Video consistency scoring (AV) | `Qwen/Qwen2.5-Omni-7B` |
42
+
43
+ ## Notes
44
+
45
+ These models are released for AVBench evaluation and analysis.