Axon β€” SmolLM2-360M Portfolio Assistant

Fine-tuned SmolLM2-360M-Instruct to serve as a personal portfolio AI assistant. Runs entirely in the browser via WebGPU + Transformers.js.

What is Axon?

Axon is a client-side AI assistant embedded in a Three.js 3D portfolio website. It answers questions about the portfolio owner (Akshay Mhaskar) β€” work experience, skills, projects, and contact info. Zero backend, zero API costs, fully private.

Training

  • Method: LoRA (rank=32, alpha=64) fine-tuning via TRL SFTTrainer
  • Dataset: 1,001 curated chat examples (knowledge Q&A, refusal training, edge cases)
  • Hardware: NVIDIA RTX 5090
  • Base model: SmolLM2-360M-Instruct
  • Precision: bf16
  • Train loss: 1.33
  • Eval loss: 0.94
  • Token accuracy: 80%
  • Training time: 6 minutes

Usage (Browser β€” Transformers.js)

import { pipeline } from '@huggingface/transformers';

const generator = await pipeline('text-generation', 'celestialcreator/axon-smollm2-360m', {
  dtype: 'q4f16',
  device: 'webgpu',
});

const result = await generator([
  { role: 'user', content: 'Who is Akshay?' }
], { max_new_tokens: 150 });

Usage (Python)

from transformers import pipeline

pipe = pipeline("text-generation", model="celestialcreator/axon-smollm2-360m")
result = pipe([{"role": "user", "content": "Who is Akshay?"}], max_new_tokens=150)
Downloads last month
853
Safetensors
Model size
0.4B params
Tensor type
F16
Β·
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for celestialcreator/axon-smollm2-360m

Adapter
(31)
this model