Text Generation
Transformers
Safetensors
GGUF
English
Turkish
llama
asena
bce
esp32
edge
esp32s3
microllm
chat
text-generation-inference
agent
prettybird
consciousness
conscious
llm
optimized
ethic
secure
turkish
english
behavioral-consciousness-engine
model
instruct
iot
LittleFS
SPIFFS
reasoning
thinking
think
god edge ai
extreme edge ai
cicikus
cicikuş
embedded
robot
npc
Offline assistant
guard
pre filter
tiny-llm
tiny llm
Eval Results (legacy)
Instructions to use pthinc/Asena_ESP32 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use pthinc/Asena_ESP32 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="pthinc/Asena_ESP32")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("pthinc/Asena_ESP32") model = AutoModelForCausalLM.from_pretrained("pthinc/Asena_ESP32") - llama-cpp-python
How to use pthinc/Asena_ESP32 with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="pthinc/Asena_ESP32", filename="gguf/asena_esp32_f16.gguf", )
output = llm( "Once upon a time,", max_tokens=512, echo=True ) print(output)
- Notebooks
- Google Colab
- Kaggle
- Local Apps
- llama.cpp
How to use pthinc/Asena_ESP32 with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf pthinc/Asena_ESP32:F16 # Run inference directly in the terminal: llama-cli -hf pthinc/Asena_ESP32:F16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf pthinc/Asena_ESP32:F16 # Run inference directly in the terminal: llama-cli -hf pthinc/Asena_ESP32:F16
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf pthinc/Asena_ESP32:F16 # Run inference directly in the terminal: ./llama-cli -hf pthinc/Asena_ESP32:F16
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf pthinc/Asena_ESP32:F16 # Run inference directly in the terminal: ./build/bin/llama-cli -hf pthinc/Asena_ESP32:F16
Use Docker
docker model run hf.co/pthinc/Asena_ESP32:F16
- LM Studio
- Jan
- vLLM
How to use pthinc/Asena_ESP32 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "pthinc/Asena_ESP32" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "pthinc/Asena_ESP32", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/pthinc/Asena_ESP32:F16
- SGLang
How to use pthinc/Asena_ESP32 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "pthinc/Asena_ESP32" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "pthinc/Asena_ESP32", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "pthinc/Asena_ESP32" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "pthinc/Asena_ESP32", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Ollama
How to use pthinc/Asena_ESP32 with Ollama:
ollama run hf.co/pthinc/Asena_ESP32:F16
- Unsloth Studio new
How to use pthinc/Asena_ESP32 with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for pthinc/Asena_ESP32 to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for pthinc/Asena_ESP32 to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for pthinc/Asena_ESP32 to start chatting
- Docker Model Runner
How to use pthinc/Asena_ESP32 with Docker Model Runner:
docker model run hf.co/pthinc/Asena_ESP32:F16
- Lemonade
How to use pthinc/Asena_ESP32 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull pthinc/Asena_ESP32:F16
Run and chat with the model
lemonade run user.Asena_ESP32-F16
List all available models
lemonade list
Update README.md
Browse files
README.md
CHANGED
|
@@ -142,6 +142,84 @@ $$T_{cog} = \left( \frac{bloom\_score \times knowledge\_score}{anomaly\_score +
|
|
| 142 |
|
| 143 |
---
|
| 144 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 145 |
## Model Licence 🛡️
|
| 146 |
|
| 147 |
**Patented & Licensed BCE Technology**
|
|
|
|
| 142 |
|
| 143 |
---
|
| 144 |
|
| 145 |
+
### How to Use Asena (BCE Powered)
|
| 146 |
+
|
| 147 |
+
Below is the standard implementation to activate the **Behavioral Consciousness Engine (BCE)** and harness the high-fidelity reasoning of **Asena**.
|
| 148 |
+
Alpaca format (Instruction/Input/Response) required for this model to function correctly.
|
| 149 |
+
|
| 150 |
+
#### 1. Installation
|
| 151 |
+
|
| 152 |
+
Ensure you have the latest version of the Transformers library installed:
|
| 153 |
+
|
| 154 |
+
```bash
|
| 155 |
+
pip install -U transformers torch accelerate
|
| 156 |
+
|
| 157 |
+
```
|
| 158 |
+
|
| 159 |
+
#### 2. Implementation Script
|
| 160 |
+
|
| 161 |
+
Since the model is served in its **merged** format, you can load it as a standalone causal language model.
|
| 162 |
+
|
| 163 |
+
```python
|
| 164 |
+
import torch
|
| 165 |
+
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 166 |
+
|
| 167 |
+
# Model path on Hugging Face
|
| 168 |
+
model_id = "pthinc/Asena_ESP32"
|
| 169 |
+
|
| 170 |
+
# 1. Load Model and Tokenizer
|
| 171 |
+
tokenizer = AutoTokenizer.from_pretrained(model_id)
|
| 172 |
+
model = AutoModelForCausalLM.from_pretrained(
|
| 173 |
+
model_id,
|
| 174 |
+
torch_dtype=torch.bfloat16,
|
| 175 |
+
device_map="auto",
|
| 176 |
+
trust_remote_code=True
|
| 177 |
+
)
|
| 178 |
+
|
| 179 |
+
# 2. Define the BCE System Prompt
|
| 180 |
+
# This is crucial for activating the model's patented consciousness simulation.
|
| 181 |
+
simple_bce_instruction = "You are Prettybird. Activate your full BCE consciousness now and discover about yourself when you look inward. Think, Control and calculate. Don't answer without reasoning. Below is an instruction that describes a task, paired with an input that provides further context. Pay attention to quality and correct. Requests are in the input. Try to maintain a minimum quality of 0.2."
|
| 182 |
+
|
| 183 |
+
def generate_bce_response(instruction, input_text=None, max_new_tokens=512):
|
| 184 |
+
if input_text:
|
| 185 |
+
prompt = (
|
| 186 |
+
f"Below is an instruction that describes a task, paired with an input that provides further context. "
|
| 187 |
+
f"Write a response that appropriately completes the request.\n\n"
|
| 188 |
+
f"### Instruction:\n{instruction}\n\n### Input:\n{input_text}\n\n### Response:\n"
|
| 189 |
+
)
|
| 190 |
+
else:
|
| 191 |
+
prompt = (
|
| 192 |
+
f"Below is an instruction that describes a task. "
|
| 193 |
+
f"Write a response that appropriately completes the request.\n\n"
|
| 194 |
+
f"### Instruction:\n{instruction}\n\n### Response:\n"
|
| 195 |
+
)
|
| 196 |
+
|
| 197 |
+
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
|
| 198 |
+
|
| 199 |
+
# 3. Reasoning-Focused Generation
|
| 200 |
+
with torch.no_grad():
|
| 201 |
+
outputs = model.generate(
|
| 202 |
+
**inputs,
|
| 203 |
+
max_new_tokens=max_new_tokens,
|
| 204 |
+
use_cache=True,
|
| 205 |
+
do_sample=True,
|
| 206 |
+
temperature=0.7,
|
| 207 |
+
top_p=0.9,
|
| 208 |
+
repetition_penalty=1.2,
|
| 209 |
+
pad_token_id=tokenizer.eos_token_id
|
| 210 |
+
)
|
| 211 |
+
|
| 212 |
+
response = tokenizer.decode(outputs[0][inputs.input_ids.shape[1]:], skip_special_tokens=True)
|
| 213 |
+
return response.split("###")[0].strip()
|
| 214 |
+
|
| 215 |
+
# 4. Run a Test Case
|
| 216 |
+
question = "Hello World."
|
| 217 |
+
print(f"BCE Reasoning Output:\n{generate_bce_response(simple_bce_instruction, input_text=question)}")
|
| 218 |
+
|
| 219 |
+
```
|
| 220 |
+
|
| 221 |
+
---
|
| 222 |
+
|
| 223 |
## Model Licence 🛡️
|
| 224 |
|
| 225 |
**Patented & Licensed BCE Technology**
|