Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,271

Base only

Active filters: int4

GaelicThunder/Qwen3.5-122B-A10B-heretic-hybrid-int4fp8

Text Generation • 21B • Updated Jul 20 • 370

antonyMox/Qwen3.6-27B-abliterated-AutoRound-INT4-MTP

Text Generation • 6B • Updated Jul 20 • 510 • 1

SearchingMan/FLUX.1-dev-ConvRot

Text-to-Image • Updated about 1 month ago • 3

massif/Qwen3-1.7B-CoreAI-GPU-INT4-4K-h16p

Text Generation • Updated Jul 20 • 1

antonyMox/Qwen3.6-27B-AutoRound-INT4-wide-MTP

Text Generation • 11B • Updated Jul 20 • 26

nota-ai/Solar-Open2-250B-Nota-INT4

Text Generation • 41B • Updated 29 days ago • 6.08k • 40

nota-ai/Solar-Open2-250B-Nota-INT4-GlobalPruned

Text Generation • 35B • Updated 21 days ago • 1.3k • 43

Wondernutts/Lumimaid-Magnum-v4-12B-int4-ov

Text Generation • Updated 26 days ago • 26

Wondernutts/magnum-v4-12b-int4-ov

Text Generation • Updated 26 days ago • 33

wilherman2121/Audex-30B-A3B-W4A16

7B • Updated Jul 21 • 4

wilherman2121/Audex-30B-A3B-W4A16-v2

7B • Updated Jul 21 • 4

DimQ1/nemotron-3.5-asr-streaming-0.6b-onnx-int4-opset24-c056-cpu

Automatic Speech Recognition • Updated Jul 21

DimQ1/nemotron-3.5-asr-streaming-0.6b-onnx-int4-opset24-c112-cpu

Automatic Speech Recognition • Updated Jul 21

Wondernutts/Qwen3.6-35B-A3B-StyleTune-int4-ov

Image-Text-to-Text • Updated 28 days ago • 20

LostGentoo/LFM2.5-8B-A1B-AWQ-INT4-agentic

Text Generation • 9B • Updated about 1 month ago • 12

PhalaCloud/GLM-5.2-W4A8-CT

Text Generation • 116B • Updated about 1 month ago • 54

Distillio/GLM-5.2-colibri-int4-with-int8-mtp

Updated about 1 month ago • 13

systemsofrecord/Qwen3-Coder-30B-A3B-Instruct-W4A16

Text Generation • 31B • Updated about 1 month ago • 1.14k • 1

itzune/berteus-onnx

Feature Extraction • Updated about 1 month ago • 37

itzune/gector-eus-onnx

Token Classification • Updated 26 days ago • 25

philipjohnbasile/GLM-5.2-colibri-int4-with-int8-mtp

Updated 30 days ago • 25

Ar4ikov/OmniCoder-9B-AWQ-W4A16-ASYM

Image-Text-to-Text • 10B • Updated 30 days ago • 35 • 2

groxaxo/Nemotron-3-Embed-1B-CoreML-S256-W4A16

Feature Extraction • Updated 30 days ago • 4

Ar4ikov/Ornith-1.0-9B-AWQ-W4A16-ASYM

Text Generation • 10B • Updated 30 days ago • 281 • 1

aximi/qxern-v6-deploy-int4

Updated 17 days ago

a1700878328/qwen3-asr-1.7b-onnx-int4

Automatic Speech Recognition • Updated 29 days ago • 45

ep219/GLM-5.2-colibri-int4-with-int8-mtp

Updated 29 days ago • 31

leuconoe/litert-lm-unity-quantized

Text Generation • Updated 26 days ago • 108

ilyaosovskoi/qwopus3.6-35b-a3b-coder-colibri-i4

Updated 27 days ago • 315

soyrsoyr/gemma-4-12b-it-W4A16-GPTQ

13B • Updated 29 days ago • 24