qwen3-4b-int4-ov

OpenVINO IR export of Qwen/Qwen3-4B, quantized to INT4 — 2180 MB.

Quantization weight compression, group 128, symmetric, AWQ + scale estimation
Lesson 08 LLM chatbot / 09 speculative main / 12 RAG
Built by convert/convert_all.py of the ARCademy OpenVINO courseware

openvino_genai.LLMPipeline(model_dir, device). Append ' /no_think' to a user turn to skip the reasoning block.

from huggingface_hub import snapshot_download
model_dir = snapshot_download("circulus/qwen3-4b-int4-ov")
Downloads last month
15
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for circulus/qwen3-4b-int4-ov

Finetuned
Qwen/Qwen3-4B
Finetuned
(1041)
this model