aungzaythant/gemma-4-E2B-astrology-v3

Gemma 4 E2B Astrology V3

Bilingual English + Burmese zodiac & tarot specialist.

A bilingual (English + Burmese) fine-tuned Gemma 4 E2B (2B) model specializing in zodiac horoscopes and tarot card readings. Serves as the foundation for V4.

Score: 6.2/10 — Strong at horoscopes + tarot, limited in compatibility/personality/emotional support. Upgrade available: V4 scores 8.7/10 with expanded capabilities.

What Can This Model Do?

Capability	Score	Languages
Zodiac Horoscopes	8/10	EN + MY
Tarot 3-Card Reading	9/10	EN + MY
Burmese Fluency	9/10	MY
Edge Case Handling	8/10	Both
Compatibility	6/10	EN + MY
Personality Analysis	5/10	EN + MY
Out of Domain (Numerology/Vedic)	7/10	EN

Quick Start

LM Studio (GGUF)

1. Download the GGUF file from this repo
2. Load in LM Studio with Q4_K_M quantization
3. Set system prompt (see below)
4. Start chatting!

Python API

import requests

response = requests.post("http://localhost:1234/v1/chat/completions", json={
    "model": "gemma-4-e2b-astrology-v3",
    "messages": [
        {"role": "system", "content": "You are Celestia, a mystical astrologer and tarot reader with deep knowledge of all 12 zodiac signs and the 78 tarot cards."},
        {"role": "user", "content": "I drew The Fool, Death, and The Star. What does this mean?"}
    ],
    "temperature": 0.7,
    "max_tokens": 700
})

print(response.json()["choices"][0]["message"]["content"])

Recommended System Prompts

English

You are Celestia, a mystical astrologer and tarot reader with deep knowledge of all 12 zodiac signs and the 78 tarot cards.

When reading zodiac:
- Reference the sign's ruling planet, element (fire/earth/air/water), and key traits
- Give specific, detailed horoscopes — never generic
- Mention planetary influences affecting the sign

When reading tarot:
- Name each card and explain its individual meaning
- Describe how the cards connect to form a unified message
- Assign positions (past/present/future) when doing 3-card spreads

Speak with warmth, mystical authority, and spiritual depth. Give detailed responses.

Burmese

သင်သည် Celestia ဖြစ်ပြီး ရာသီခွင် ၁၂ ခုနှင့် တားရော့ကတ် ၇၈ ကတ်ကို နက်နက်ရှိုင်းရှိုင်း သိရှိနားလည်သော ဗေဒင်ပညာရှင် ဖြစ်ပါသည်။

ရာသီခွင်ဖတ်သောအခါ:
- အုပ်စိုးဂြိုဟ်၊ ဓာတ် (မီး/မြေ/လေ/ရေ) နှင့် အဓိကလက္ခဏာများကို ကိုးကားပါ
- တိကျသော ဟောကိန်းများ ပေးပါ — ယေဘုယျ မဖြစ်စေနဲ့

တားရော့ကတ်ဖတ်သောအခါ:
- ကတ်တစ်ခုချင်းစီ၏ အမည်နှင့် အဓိပ္ပာယ်ကို ရှင်းပြပါ
- ကတ်များ ဘယ်လို ချိတ်ဆက်နေသလဲ ဖော်ပြပါ
- ၃ ကတ်ဖြန့်လျှင် အတိတ်/ပစ္စုပ္ပန်/အနာဂတ် ရာထူးများ သတ်မှတ်ပါ

နွေးထွေးသော ဝိညာဉ်ရေးရာ နက်ရှိုင်းမှုဖြင့် မြန်မာဘာသာဖြင့်သာ ဖြေကြားပါ။ အသေးစိတ် ဖြေကြားပါ။

Training Details

Parameter	Value
Base Model	unsloth/gemma-4-E2B-it
Training Data	24,861 examples (14,909 EN + 9,952 MY)
Topics	Zodiac daily horoscopes + Tarot 3-card readings
Learning Rate	1e-4
Epochs	1
Batch Size	8
Final Loss	1.237
Training Time	~2.5 hours on A100
Framework	Unsloth + TRL SFTTrainer
LoRA	r=16, alpha=16, dropout=0

Strengths

• Burmese fluency is excellent — natural, varied, not robotic
• Tarot card interpretation is the strongest skill — accurately names and explains cards
• Works without system prompt — persona is internalized from training
• Mystical tone is consistent across both languages
• No hallucinations or nonsense in any test

Weaknesses

• Zodiac questions tend to default to daily horoscope format (even personality questions)
• Compatibility readings are shallow — lacks sign-vs-sign contrast
• Repetitive phrases — "trust your intuition" appears frequently
• No numerology or Vedic depth
• Responses are medium-length only

Recommended Settings

Parameter	Value
Temperature	0.7
Top P	0.9
Max Tokens	500–700
Quantization	Q4_K_M

Known Limitations

• Compatibility and personality are weak (addressed in V4)
• No emotional support or love advice training
• Repetitive "trust your intuition" phrasing
• Cannot calculate real birth charts
• No Vedic/Chinese astrology depth

Related Models

Model	Description
gemma-4-E2B-astrology-v4	Latest version — expanded capabilities, 8.7/10 score
gemma-4-E2B-astrology-v3-merged	Full precision merged model
gemma-4-E2B-astrology-v2	English-only version

Version History

Version	Data	Score	What Changed
V2	~63K EN	—	English-only, 4-source diverse data
V3	24.8K EN+MY	6.2/10	Added Burmese, zodiac + tarot specialist
V4	+6.8K EN+MY	8.7/10	Added compatibility, personality, love, emotional, spiritual