Instructions to use BrinqAI/functiongemma-270m-physical-ai with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use BrinqAI/functiongemma-270m-physical-ai with llama-cpp-python:

# !pip install llama-cpp-python

from llama_cpp import Llama

llm = Llama.from_pretrained(
	repo_id="BrinqAI/functiongemma-270m-physical-ai",
	filename="functiongemma-physical-ai-Q4_K_M.gguf",
)

llm.create_chat_completion(
	messages = [
		{
			"role": "user",
			"content": "What is the capital of France?"
		}
	]
)

Notebooks
Google Colab
Kaggle
Local Apps

llama.cpp

How to use BrinqAI/functiongemma-270m-physical-ai with llama.cpp:

Install from brew

brew install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf BrinqAI/functiongemma-270m-physical-ai:Q4_K_M
# Run inference directly in the terminal:
llama-cli -hf BrinqAI/functiongemma-270m-physical-ai:Q4_K_M

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf BrinqAI/functiongemma-270m-physical-ai:Q4_K_M
# Run inference directly in the terminal:
llama-cli -hf BrinqAI/functiongemma-270m-physical-ai:Q4_K_M

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf BrinqAI/functiongemma-270m-physical-ai:Q4_K_M
# Run inference directly in the terminal:
./llama-cli -hf BrinqAI/functiongemma-270m-physical-ai:Q4_K_M

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf BrinqAI/functiongemma-270m-physical-ai:Q4_K_M
# Run inference directly in the terminal:
./build/bin/llama-cli -hf BrinqAI/functiongemma-270m-physical-ai:Q4_K_M

Use Docker

docker model run hf.co/BrinqAI/functiongemma-270m-physical-ai:Q4_K_M

LM Studio
Jan

vLLM

How to use BrinqAI/functiongemma-270m-physical-ai with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "BrinqAI/functiongemma-270m-physical-ai"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "BrinqAI/functiongemma-270m-physical-ai",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/BrinqAI/functiongemma-270m-physical-ai:Q4_K_M

Ollama
How to use BrinqAI/functiongemma-270m-physical-ai with Ollama:
```
ollama run hf.co/BrinqAI/functiongemma-270m-physical-ai:Q4_K_M
```

Unsloth Studio new

How to use BrinqAI/functiongemma-270m-physical-ai with Unsloth Studio:

Install Unsloth Studio (macOS, Linux, WSL)

curl -fsSL https://unsloth.ai/install.sh | sh
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for BrinqAI/functiongemma-270m-physical-ai to start chatting

Install Unsloth Studio (Windows)

irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for BrinqAI/functiongemma-270m-physical-ai to start chatting

Using HuggingFace Spaces for Unsloth

# No setup required
# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for BrinqAI/functiongemma-270m-physical-ai to start chatting

Pi new

How to use BrinqAI/functiongemma-270m-physical-ai with Pi:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama-server -hf BrinqAI/functiongemma-270m-physical-ai:Q4_K_M

Configure the model in Pi

# Install Pi:
npm install -g @mariozechner/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "llama-cpp": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "BrinqAI/functiongemma-270m-physical-ai:Q4_K_M"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Hermes Agent new

How to use BrinqAI/functiongemma-270m-physical-ai with Hermes Agent:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama-server -hf BrinqAI/functiongemma-270m-physical-ai:Q4_K_M

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default BrinqAI/functiongemma-270m-physical-ai:Q4_K_M

Run Hermes

hermes

Docker Model Runner
How to use BrinqAI/functiongemma-270m-physical-ai with Docker Model Runner:
```
docker model run hf.co/BrinqAI/functiongemma-270m-physical-ai:Q4_K_M
```

Lemonade

How to use BrinqAI/functiongemma-270m-physical-ai with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull BrinqAI/functiongemma-270m-physical-ai:Q4_K_M

Run and chat with the model

lemonade run user.functiongemma-270m-physical-ai-Q4_K_M

List all available models

lemonade list

hmahadik commited on 21 days ago

Commit

e7ff352

verified ·

1 Parent(s): e515857

Add tools.json (13-tool schema, board-neutral)

Browse files

Files changed (1) hide show

tools.json +230 -0

tools.json ADDED Viewed

	@@ -0,0 +1,230 @@

+{
+  "version": "0.1.0",
+  "description": "Physical AI tool schema (lights, buzzer, alarms, camera, system status, plus respond fallback). Canonical mobile-actions format.",
+  "tools": [
+    {
+      "function": {
+        "name": "turn_on_lights",
+        "description": "Turn on all RGB LEDs and the Neopixel strip to default white.",
+        "parameters": {
+          "type": "OBJECT",
+          "properties": {}
+        }
+      }
+    },
+    {
+      "function": {
+        "name": "turn_off_lights",
+        "description": "Turn off all RGB LEDs and the Neopixel strip.",
+        "parameters": {
+          "type": "OBJECT",
+          "properties": {}
+        }
+      }
+    },
+    {
+      "function": {
+        "name": "set_led_color",
+        "description": "Set the color of RGB LEDs on the HAT or Neopixel strip.",
+        "parameters": {
+          "type": "OBJECT",
+          "properties": {
+            "color": {
+              "type": "STRING",
+              "description": "Color name (e.g. 'red', 'green', 'blue', 'white', 'orange', 'purple') or 6-digit hex (e.g. '#FF8800')."
+            },
+            "target": {
+              "type": "STRING",
+              "description": "Which lights to set: 'all' (default), 'hat' (RGB LEDs on HAT), or 'strip' (Neopixels)."
+            },
+            "brightness": {
+              "type": "INTEGER",
+              "description": "Brightness 0-100. Optional, default 100."
+            }
+          },
+          "required": [
+            "color"
+          ]
+        }
+      }
+    },
+    {
+      "function": {
+        "name": "blink_lights",
+        "description": "Blink LEDs a given number of times, optionally in a specific color and speed.",
+        "parameters": {
+          "type": "OBJECT",
+          "properties": {
+            "count": {
+              "type": "INTEGER",
+              "description": "Number of blinks. Default 3."
+            },
+            "color": {
+              "type": "STRING",
+              "description": "Color to blink. Default current color or white."
+            },
+            "speed": {
+              "type": "STRING",
+              "description": "One of 'slow', 'normal', 'fast'. Default 'normal'."
+            }
+          }
+        }
+      }
+    },
+    {
+      "function": {
+        "name": "set_neopixel_pattern",
+        "description": "Play an animated pattern on the Neopixel strip.",
+        "parameters": {
+          "type": "OBJECT",
+          "properties": {
+            "pattern": {
+              "type": "STRING",
+              "description": "One of 'rainbow', 'chase', 'fade', 'pulse', 'sparkle', 'solid'."
+            },
+            "color": {
+              "type": "STRING",
+              "description": "Color for patterns that need one (chase/fade/pulse/solid). Ignored for rainbow."
+            },
+            "speed": {
+              "type": "STRING",
+              "description": "One of 'slow', 'normal', 'fast'. Default 'normal'."
+            }
+          },
+          "required": [
+            "pattern"
+          ]
+        }
+      }
+    },
+    {
+      "function": {
+        "name": "play_buzzer",
+        "description": "Play a named pattern on a piezo buzzer wired to a binary GPIO. Only timed patterns are supported — no tunable frequency.",
+        "parameters": {
+          "type": "OBJECT",
+          "properties": {
+            "pattern": {
+              "type": "STRING",
+              "description": "Named pattern: 'beep', 'double_beep', 'siren', 'chirp', 'alarm', 'success', 'error'."
+            }
+          },
+          "required": [
+            "pattern"
+          ]
+        }
+      }
+    },
+    {
+      "function": {
+        "name": "set_alarm",
+        "description": "Schedule an alarm to go off at a given time or after a duration. Alarm triggers buzzer + flashing LEDs.",
+        "parameters": {
+          "type": "OBJECT",
+          "properties": {
+            "duration": {
+              "type": "STRING",
+              "description": "Relative time like '1 minute', '30 seconds', '2 hours'. Use this OR 'time', not both."
+            },
+            "time": {
+              "type": "STRING",
+              "description": "Absolute time HH:MM (24-hour). Use this OR 'duration', not both."
+            },
+            "label": {
+              "type": "STRING",
+              "description": "Optional human-readable label for the alarm."
+            }
+          }
+        }
+      }
+    },
+    {
+      "function": {
+        "name": "cancel_alarm",
+        "description": "Cancel a scheduled alarm. If no label is given, cancel all alarms.",
+        "parameters": {
+          "type": "OBJECT",
+          "properties": {
+            "label": {
+              "type": "STRING",
+              "description": "Label of the alarm to cancel. Omit to cancel all."
+            }
+          }
+        }
+      }
+    },
+    {
+      "function": {
+        "name": "list_alarms",
+        "description": "List all currently scheduled alarms with their trigger times.",
+        "parameters": {
+          "type": "OBJECT",
+          "properties": {}
+        }
+      }
+    },
+    {
+      "function": {
+        "name": "get_system_status",
+        "description": "Report device system status (CPU load, memory, temperature, NPU utilization).",
+        "parameters": {
+          "type": "OBJECT",
+          "properties": {
+            "metric": {
+              "type": "STRING",
+              "description": "Specific metric: 'cpu', 'memory', 'temperature', 'npu', or 'all' (default)."
+            }
+          }
+        }
+      }
+    },
+    {
+      "function": {
+        "name": "capture_photo",
+        "description": "Capture a photo from the MIPI camera on the HAT.",
+        "parameters": {
+          "type": "OBJECT",
+          "properties": {
+            "save_as": {
+              "type": "STRING",
+              "description": "Optional filename. Default timestamp-based."
+            }
+          }
+        }
+      }
+    },
+    {
+      "function": {
+        "name": "describe_scene",
+        "description": "Capture a photo and describe what is visible using the Gemma3 vision model on Torq NPU.",
+        "parameters": {
+          "type": "OBJECT",
+          "properties": {
+            "question": {
+              "type": "STRING",
+              "description": "Optional question about the scene. Default: 'What do you see?'"
+            }
+          }
+        }
+      }
+    },
+    {
+      "function": {
+        "name": "respond",
+        "description": "Reply to the user in natural language without taking any physical action. Use this when the request is out of scope (no matching tool), ambiguous (needs clarification), purely conversational (greetings, thanks), or impossible on this device. Do NOT use this when any physical-action tool fits the request.",
+        "parameters": {
+          "type": "OBJECT",
+          "properties": {
+            "message": {
+              "type": "STRING",
+              "description": "The natural-language reply to show to the user."
+            }
+          },
+          "required": [
+            "message"
+          ]
+        }
+      }
+    }
+  ]
+}