Cicikus v3 Prometheus 4.4B - An Experimental Franken-Merge for Edge Reasoning

#1
by prometechinc - opened
PROMETECH BİLGİSAYAR BİLİMLERİ YAZILIM İTHALAT İHRACAT TİCARET ANONİM ŞİRKETİ org

Hi everyone,

We are excited to share an experimental release from Prometech: Cicikus v3 Prometheus 4.4B.

This model is a targeted passthrough expansion of the Llama 3.2 3B architecture. Instead of a traditional merge, we identified "Hot Zones" through L2 norm analysis of trained adapters to expand the model to 40 layers (~4.42B parameters).

Key Features:

BCE Integration: Fine-tuned with our Behavioral Consciousness Engine for improved self-audit and reasoning.

Context: 32k token support.

Edge Optimized: Designed to run high-density reasoning tasks on consumer hardware (8GB Safetensors).

It is currently optimized for STEM and logical reasoning tasks. We are looking forward to community feedback and benchmarks.

Sign up or log in to comment