Text Generation
Transformers
Safetensors
PyTorch
English
mistral3
image-text-to-text
reasoning
coding
math
science
instruction-tuned
mistral
conversational
Instructions to use Surpem/Supertron2-24B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Surpem/Supertron2-24B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Surpem/Supertron2-24B") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# Load model directly from transformers import AutoProcessor, AutoModelForImageTextToText processor = AutoProcessor.from_pretrained("Surpem/Supertron2-24B") model = AutoModelForImageTextToText.from_pretrained("Surpem/Supertron2-24B") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Inference
- Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use Surpem/Supertron2-24B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Surpem/Supertron2-24B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Surpem/Supertron2-24B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Surpem/Supertron2-24B
- SGLang
How to use Surpem/Supertron2-24B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Surpem/Supertron2-24B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Surpem/Supertron2-24B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Surpem/Supertron2-24B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Surpem/Supertron2-24B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use Surpem/Supertron2-24B with Docker Model Runner:
docker model run hf.co/Surpem/Supertron2-24B
File size: 3,563 Bytes
21c8b35 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 | ---
license: apache-2.0
language:
- en
base_model:
- mistralai/Devstral-Small-2-24B-Instruct-2512
pipeline_tag: text-generation
library_name: transformers
tags:
- reasoning
- coding
- math
- science
- instruction-tuned
- mistral
- pytorch
---
# **Supertron2-24B: A Capable Instruction-Tuned Coding and Reasoning Model**
## **Model Description**
**Supertron2-24B** is an instruction-tuned language model built on top of [mistralai/Devstral-Small-2-24B-Instruct-2512](https://huggingface.co/mistralai/Devstral-Small-2-24B-Instruct-2512). It is designed for practical coding assistance, structured reasoning, math, science, general chat, and everyday instruction following.
* **Developed by:** Surpem
* **Model type:** Causal Language Model
* **Architecture:** Dense Transformer, 24B parameters
* **License:** Apache 2.0
---
## **Capabilities**
### **Coding**
Supertron2-24B is designed to help write, explain, and debug code. It can assist with practical programming tasks, implementation planning, error analysis, and code review style explanations.
### **Reasoning**
The model can work through multi-step questions, compare options, follow structured instructions, and produce concise answers when requested.
### **Math**
Supertron2-24B can handle arithmetic, algebra-style problems, word problems, and step-by-step mathematical explanations.
### **Science**
The model can explain scientific concepts clearly, answer STEM questions, and help with educational or technical writing.
### **General Chat**
Supertron2-24B can assist with writing, brainstorming, explanations, planning, summarization, and general everyday questions.
---
## **Get Started**
```python
from transformers import AutoTokenizer, AutoModelForImageTextToText
import torch
model_id = "Surpem/Supertron2-24B"
tokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True)
model = AutoModelForImageTextToText.from_pretrained(
model_id,
torch_dtype=torch.bfloat16,
device_map="auto",
trust_remote_code=True,
)
messages = [
{"role": "user", "content": "Write a Python function that checks if a string is a palindrome."}
]
text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(text, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=512)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:], skip_special_tokens=True))
```
---
## **Hardware Requirements**
| Precision | Min VRAM | Recommended |
|---|---:|---:|
| bfloat16 | 48 GB | 80 GB+ |
| 4-bit quantized | 16 GB | 24 GB+ |
For long contexts or larger batches, use more VRAM or reduce batch size and max sequence length.
---
## **Intended Use**
Supertron2-24B is intended for:
* Coding assistance
* Software engineering reasoning
* Math and science explanations
* General chat and instruction following
* Writing, summarization, and brainstorming
* Research and technical assistance
---
## **Limitations**
* The model can make mistakes and should be checked for important work.
* It may produce incorrect code, incomplete reasoning, or outdated information.
* It should not be used as the only source for medical, legal, financial, or safety-critical decisions.
* Generated code should be reviewed and tested before use.
---
## **Citation**
```bibtex
@misc{surpem2026supertron2-24b,
title={Supertron2-24B -- Instruction-Tuned Coding and Reasoning Model},
author={Surpem},
year={2026},
url={https://huggingface.co/Surpem/Supertron2-24B},
}
```
|