npahwa
/

ner-json-qwen-q8_0-gguf

named-entity-recognition

information-extraction

Model card Files Files and versions

ner-json-qwen-q8_0-gguf

This repository contains the Q8_0 GGUF deployment artifact for the NER-to-JSON extraction project.

Base model

Qwen/Qwen2.5-1.5B-Instruct

Quantization

GGUF Q8_0

Purpose

This artifact is intended for deployment and demo serving.

Downloads last month: 211

GGUF

Model size

2B params

Architecture

qwen2

Hardware compatibility

Log In to add your hardware

8-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for npahwa/ner-json-qwen-q8_0-gguf

Base model

Qwen/Qwen2.5-1.5B

Finetuned

Qwen/Qwen2.5-1.5B-Instruct

Quantized

(169)

this model

Spaces using npahwa/ner-json-qwen-q8_0-gguf 3