qwen2-5_convos__SCP_org_chemistry — RKLLM build for RK3588 boards

Author: @jamescallander
Source model: mlfoundations-dev/qwen2-5_convos__SCP_org_chemistry · Hugging Face
Target: Rockchip RK3588 NPU via RKNN-LLM Runtime

This repository hosts a conversion of qwen2-5_convos__SCP_org_chemistry for use on Rockchip RK3588 single-board computers (Orange Pi 5 plus, Radxa Rock 5b+, Banana Pi M7, etc.). Conversion was performed using the RKNN-LLM toolkit

Conversion details

RKLLM-Toolkit version: v1.2.1
Python: 3.12
Quantization: w8a8_g128
Output: single-file .rkllm artifact
Tokenizer: not required at runtime (UI handles prompt I/O)

⚠️ Safety disclaimer

🧪 This model is intended for research and educational use only.
🧬 It does not provide real chemical or safety advice.
🧍‍♂️ Do not rely on its output for laboratory, medical, or safety-critical decisions.
Follow all laws, safety regulations, and the source model’s usage policy.

Intended use

On-device deployment of qwen2-5_convos__SCP_org_chemistry, tuned for scientific dialogue, chemistry-related reasoning, and creative generation.
The base model, Qwen2.5-Convos, is an instruction-tuned conversational model further specialized toward organic chemistry and SCP-style reasoning/conversation.
This conversion allows local experimentation, offline study, or private use in education and research contexts.

Limitations

Requires 8GB free memory
Outputs are not validated and may contain inaccuracies.
Quantized build (w8a8_g128) may show small quality differences vs. full-precision upstream.
Tested on Radxa Rock 5B+; other devices may require different drivers/toolkit versions.
Not a chemistry computation engine — it simulates reasoning, not molecular prediction.

Quick start (RK3588)

1) Install runtime

The RKNN-LLM toolkit and instructions can be found on the specific development board's manufacturer website or from airockchip's github page.

Download and install the required packages as per the toolkit's instructions.

2) Simple Flask server deployment

The simplest way the deploy the .rkllm converted model is using an example script provided in the toolkit in this directory: rknn-llm/examples/rkllm_server_demo

python3 <TOOLKIT_PATH>/rknn-llm/examples/rkllm_server_demo/flask_server.py \
  --rkllm_model_path <MODEL_PATH>/qwen2-5_convos__SCP_org_chemistry_w8a8_g128_rk3588.rkllm \
  --target_platform rk3588

3) Sending a request

A basic format for message request is:

{
    "model":"qwen2-5_convos__SCP_org_chemistry",
    "messages":[{
        "role":"user",
        "content":"<YOUR_PROMPT_HERE>"}],
    "stream":false
}

Example request using curl:

curl -s -X POST <SERVER_IP_ADDRESS>:8080/rkllm_chat \
    -H 'Content-Type: application/json' \
    -d '{"model":"qwen2-5_convos__SCP_org_chemistry","messages":[{"role":"user","content":"What is a Lewis acid?"}],"stream":false}'

The response is formated in the following way:

{
    "choices":[{
        "finish_reason":"stop",
        "index":0,
        "logprobs":null,
        "message":{
            "content":"<MODEL_REPLY_HERE">,
            "role":"assistant"}}],
        "created":null,
        "id":"rkllm_chat",
        "object":"rkllm_chat",
        "usage":{
            "completion_tokens":null,
            "prompt_tokens":null,
            "total_tokens":null}
}

Example response:

{"choices":[{"finish_reason":"stop","index":0,"logprobs":null,"message":{"content":"<think> Okay, so I need to figure out what a Lewis acid is. Let me start by recalling what I know about acids in general. There's the Brønsted-Lowry definition, where an acid is a proton donor, and a base is a proton acceptor. But the question here is about a Lewis acid, which I think is different from that. I remember that G.N. Lewis proposed another theory for acids and bases. Maybe Lewis acids are something else? Let me try to recall. Oh right! The Lewis definition is broader than Brønsted-Lowry. Instead of just protons, Lewis acids are substances that can accept electron pairs. So, if an acid accepts electrons, it's a Lewis acid. Wait, so in reactions where there's a transfer of electrons, the species that takes the pair would be the Lewis acid. For example, in the formation of a coordinate covalent bond, one atom donates a pair of electrons, and another accepts it. The acceptor is the Lewis acid. Let me think of some examples. Aluminum chloride (AlCl3) is a common Lewis acid catalyst. It can accept an electron pair from something like ammonia to form AlCl4^- and NH3^+. So here, AlCl3 is the Lewis acid because it's accepting electrons. Another example might be boron trifluoride (BF3). Boron has an empty p orbital and can accept a lone pair from fluoride ions. That forms BF4^- when F- donates electrons to B. Wait, but how does this differ from Brønsted acids? A Brønsted acid donates protons, which are H+ ions. But Lewis acids don't necessarily involve protons; they just need a vacant orbital to accept an electron pair. So even without sharing a proton, substances can act as Lewis acids. So the key points for a Lewis acid would be: ability to accept an electron pair, having an empty orbital or positive charge that can attract electrons. The Lewis acid doesn't have to be positively charged, though. For example, in some cases, a neutral molecule with vacant orbitals can act as a Lewis acid. Wait, but what about something like Fe^3+? It's positively charged and might accept electron pairs. But maybe more commonly, the Lewis acids are things like metal ions or molecules with empty orbitals. So, in summary, a Lewis acid is any species that can accept an electron pair from a donor to form a coordinate covalent bond. I should also mention that the corresponding base would be a Lewis base, which donates the electron pair. So in reactions where such transfers happen, both are involved. The classic example is the formation of a complex ion, like when NH3 acts as a Lewis base and donates electrons to AlCl3. Let me check if I'm missing anything. Are there any exceptions or special cases? Maybe some Lewis acids can also act as Brønsted acids? For instance, H+ itself can be both, but typically in the context of Lewis acid/base theory, they focus on electron pair acceptance rather than proton transfer. Another example: In the reaction between NH3 and H2O. Wait, no, that's more Brønsted. But if we have something like NH3 reacting with a Lewis acid like BF3, then NH3 donates electrons to BF3. So in that case, BF3 is the Lewis acid. I think I've got the main points. To define a Lewis acid concisely: It's a chemical species that accepts an electron pair to form a coordinate covalent bond. This can happen through various means, such as having vacant orbitals or being positively charged. Examples include AlCl3, BF3, and metal ions like Fe^3+. </think> A **Lewis acid** is a chemical species that has the ability to accept an electron pair from another atom or molecule, thereby forming a coordinate covalent bond. This concept, introduced by G.N. Lewis in 1923, broadens the definition of acids beyond proton donors (as in the Brønsted-Lowry theory). Key characteristics and examples include: ### **Key Characteristics**: 1. **Electron Pair Acceptance**: The species must have an empty orbital or a positive charge that can attract and accept an electron pair. 2. **Coordinate Covalent Bond Formation**: By accepting electrons, the Lewis acid forms a bond with the donor (a Lewis base). ### **Examples**: - **Aluminum Chloride (AlCl₃)**: Accepts a lone pair from ammonia (NH₃) to form AlCl₄⁻. - **Boron Trifluoride (BF₃)**: Uses its vacant p-orbital to accept an electron pair from F⁻, forming BF₄⁻. - **Metal Ions**: Positively charged metal ions like Fe³⁺ can act as Lewis acids by accepting electron pairs. ### **Contrast with Brønsted Acids**: - While Brønsted acids donate protons (H⁺), Lewis acids focus on electron pair acceptance, which may or may not involve protons. For example, BF₃ is a Lewis acid but does not donate H⁺. ### **Applications**: Lewis acids are widely used in catalysis (e.g., AlCl₃ in Friedel-Crafts reactions) and complexation chemistry (e.g., Fe³⁺ forming complexes with ligands like H₂O or NH₃). In summary, a Lewis acid is defined by its capacity to accept an electron pair, enabling the formation of coordinate covalent bonds. This concept underscores the importance of electron distribution in chemical reactivity beyond simple proton transfer.","role":"assistant"}}],"created":null,"id":"rkllm_chat","object":"rkllm_chat","usage":{"completion_tokens":null,"prompt_tokens":null,"total_tokens":null}}

4) UI compatibility

This server exposes an OpenAI-compatible Chat Completions API.

You can connect it to any OpenAI-compatible client or UI (for example: Open WebUI

Configure your client with the API base:

http://<SERVER_IP_ADDRESS>:8080

and use the endpoint:

/rkllm_chat

Make sure the model field matches the converted model’s name, for example:

{
 "model": "qwen2-5_convos__SCP_org_chemistry",
 "messages": [{"role":"user","content":"Hello!"}],
 "stream": false
}

Note on reasoning traces

This model outputs intermediate reasoning text (e.g., SCP-style analysis or chemical rationale) before the final reply, sometimes enclosed by special tags such as </think> or markdown delimiters.
Many UIs automatically hide this internal reasoning; if yours doesn’t, you may see both the reasoning and the final answer.