Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
Log In
Sign Up

Ailiance-fr
/

devstral-cpp-lora

Text Generation

Model card Files Files and versions

Instructions to use Ailiance-fr/devstral-cpp-lora with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries
PEFT
How to use Ailiance-fr/devstral-cpp-lora with PEFT:
```
Task type is invalid.
```

How to use Ailiance-fr/devstral-cpp-lora with MLX:

# Make sure mlx-lm is installed
# pip install --upgrade mlx-lm
# if on a CUDA device, also pip install mlx[cuda]

# Generate text with mlx-lm
from mlx_lm import load, generate

model, tokenizer = load("Ailiance-fr/devstral-cpp-lora")

prompt = "Once upon a time in"
text = generate(model, tokenizer, prompt=prompt, verbose=True)

Notebooks
Google Colab
Kaggle
Local Apps
LM Studio

How to use Ailiance-fr/devstral-cpp-lora with MLX LM:

Generate or start a chat session

# Install MLX LM
uv tool install mlx-lm
# Generate some text
mlx_lm.generate --model "Ailiance-fr/devstral-cpp-lora" --prompt "Once upon a time"

devstral-cpp-lora / lmstudio:

Commit History