Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
mr3haque
/
OmniAgent
like
0
Any-to-Any
Safetensors
mr3haque/OmniAgent-Data
English
multimodal
agent
reinforcement-learning
dpo
grpo
simpo
mm-dpo
imagebind
vicuna
stable-diffusion
audioldm
tool-use
cvpr
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
main
OmniAgent
55.8 GB
Ctrl+K
Ctrl+K
1 contributor
History:
24 commits
mr3haque
Add verified inference notebook with all capabilities demo
87695a8
verified
9 days ago
backbone
Upload OmniAgent checkpoint (Stage 4 MM-DPO + Stage 1.5 projector)
2 months ago
configs
Upload all OmniAgent checkpoints, eval results, figures, notebooks
about 2 months ago
eval_results
Update eval results from full dataset evaluation
9 days ago
figures
Update publication figures with real data
9 days ago
notebooks
Add verified inference notebook with all capabilities demo
9 days ago
stage1_encode
Update stage1_encode: Stage 1: Input projector (retrained Mar 8)
9 days ago
stage2_decode
Update stage2_decode: Stage 2: Output projectors (retrained Mar 9)
9 days ago
stage3_sft
Update stage3_sft: Stage 3: Agentic SFT (retrained Mar 16)
9 days ago
stage4_dpo
Update stage4_dpo: Stage 4: DPO (retrained Mar 19)
9 days ago
stage4_grpo
Re-upload retrained grpo checkpoint (3 epochs, 50K data)
9 days ago
stage4_grpo_plus
Re-upload retrained grpo_plus checkpoint (3 epochs, 50K data)
9 days ago
stage4_mm_dpo
Update stage4_mm_dpo: Stage 4: MM-DPO (retrained Mar 24)
9 days ago
stage4_online_grpo
Re-upload retrained online_grpo checkpoint (3 epochs, 50K data)
9 days ago
stage4_simpo
Update stage4_simpo: Stage 4: SimPO (retrained Mar 24)
9 days ago
tokenizer
Upload OmniAgent checkpoint (Stage 4 MM-DPO + Stage 1.5 projector)
2 months ago
.gitattributes
Safe
2.3 kB
Update publication figures with real data
9 days ago
README.md
11.4 kB
Update README: SOTA contributions, GitHub link, real retrained metrics
9 days ago
input_projector.pt
Safe
pickle
Detected Pickle imports (3)
"torch.FloatStorage"
,
"torch._utils._rebuild_tensor_v2"
,
"collections.OrderedDict"
What is a pickle import?
2.17 GB
xet
Upload OmniAgent checkpoint (Stage 4 MM-DPO + Stage 1.5 projector)
2 months ago
output_projectors.pt
Suspicious
pickle
Detected Pickle imports (3)
"collections.OrderedDict"
,
"torch.BFloat16Storage"
,
"torch._utils._rebuild_tensor_v2"
What is a pickle import?
158 MB
xet
Upload OmniAgent checkpoint (Stage 4 MM-DPO + Stage 1.5 projector)
2 months ago
rl_comparison.json
Safe
11.8 kB
Add rl_comparison.json to root for easy access
9 days ago
