File size: 2,489 Bytes
49456ee 7d2df74 49456ee 58b1aad 3fca0cd ea10953 58b1aad 3fca0cd fcd32cf 58b1aad 3fca0cd fcd32cf 58b1aad 3fca0cd d241cfe 6defca0 3fca0cd b143649 d241cfe 3fca0cd 5525c30 b143649 4aeadad 9ede480 ce1dbfe 6defca0 ce1dbfe 3fca0cd 96cb124 25d99d0 985e811 25d99d0 3fca0cd 25d99d0 3fca0cd | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 | ---
title: README
emoji: 🏆
colorFrom: gray
colorTo: green
sdk: static
pinned: false
---
<img src="https://cdn-uploads.huggingface.co/production/uploads/697f2832c2c5e4daa93cece7/dLbJid_a6DBmVhoVLKo0m.png" width="300">
# Welcome to SupraLabs!
## Who we are
We are @AxionLab-official, @LH-Tech-AI and @av-codes. We are creating small open-source models for everyone.
## What we do
We train, finetune, and explore small models. Our goal is to revolutionize small AI models by making them accessible to everyone!
## What we do NOT do
We are **not** making bad (or we try not to!) models and we try to fully open source our models and code. Some models may be fully opensourced, while others might not.
## Models
- OUR TOP MODEL: Supra 50M Instruct: a 50m model which is VERY good! Our flagship.
- Supra Mini 0.1M: Trained on Kaggle 2xT4, 100k parameters, compared to models 10x it size
- Supra Mini **v2** 0.1M: the second version of the Supra Mini series.
- Supra Mini **v3** 0.5M: the third version of the Supra Mini series.
- Supra Mini **v4** 2M: the fourth version of the Supra Mini series. Improved. More powerful. With context understanding.
- Supra Mini **v5** 8M: the fifth version of the Supra Mini series. A huge token-eater monster compared to its siblings.
- MicroSupra 1k: Trained on GTX 750 Ti 4GB, a scaling laws experiment.
- StorySupra-10M: Trained on RTX 5060 Ti 16GB for 10 minutes, coherent.
- DistillSupra-0.2M: Trained on GTX 750 Ti 4GB for 30 minutes, still incoherent, but the first step for distillation research.
- **More Coming Soon! Comeback later!**
## Competing with other creators
We are competing with @CompactAI-O, @LH-Tech-AI(we know it's funny to compete against your own founder, but anyway 🤣) and @AxiomicLabs.
<br>See all of our and our competitors tiny models here: [https://lh-tech.de/ai/compare-tiny-models.html](https://lh-tech.de/ai/compare-tiny-models.html)
## Future models
- Supra-124M: Base, Chat, Reasoning - Trained on RTX 5060 Ti 16GB, with Nvidia technologies and CUDA
## Hardware
- RTX 5060 Ti 16GB (LH-Tech AI)
- GTX 750Ti 4GB (AxionLab)
- RTX 4090 Mobile 16GB (Everlier)
## Blog
[https://huggingface.co/spaces/SupraLabs/Blog](https://huggingface.co/spaces/SupraLabs/Blog)
## Feedback and Support
Feedback and support welcomed. Feel free to ask to join our organization if you want!
## Note
Some content, such as our blogs or readmes, may be created with the help of AI because not all of us have strong English skills. |