Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,733

Base only

Active filters: quantization

caiovicentino1/polarquant-skills

Updated Apr 10 • 1

MJPansa/MiniMax-M2.7-REAP-172B-A10B-AutoRound-W4A16

Text Generation • 24B • Updated Apr 15 • 1.66k • 10

Abiray/Qwen3.6-35B-A3B-Q6_K-GGUF

Image-Text-to-Text • 35B • Updated Apr 16 • 462 • 3

YTan2000/Qwen3.6-35B-A3B-TQ3_4S

Image-Text-to-Text • 35B • Updated Apr 18 • 1.04k • 79

sphaela/gemma-4-26B-A4B-it-AutoRound-GGUF

25B • Updated Apr 24 • 518 • 7

AMAImedia/Qwen3.5-35B-A3B-Darwin-Opus-NOESIS-AWQ-INT8

Text Generation • 37B • Updated Apr 26 • 19 • 11

BrickJZ/llama.cpp-TQ3-Windows-NVIDIA

Updated Apr 23 • 1

EnsueAI/DeepSeek-V4-Flash-Base-INT4

Updated Apr 26 • 6

keithnull/Qwen3.6-VL-REAP-26B-A3B-GGUF

Image-Text-to-Text • 27B • Updated May 5 • 1.82k • 5

w-ahmad/Qwen3.5-9B-GGUF-MoQ

Text Generation • 9B • Updated 11 days ago • 18.8k • 21

lyf/Qwen3.6-27B-heretic-v2-mtp-int4-AutoRound

Image-Text-to-Text • 3B • Updated Apr 28 • 3.07k • 9

feanors/nemotron-3-nano-omni-30b-a3b-awq

Image-Text-to-Text • 33B • Updated May 1 • 3.64k • 3

JANGQ-AI/MiniMax-M2.7-JANGTQ_K

Text Generation • 20B • Updated May 8 • 642 • 13

Zhongzhu/OSCAR-RotationZoo

Text Generation • Updated 10 days ago • 6

axelbrons/gemma-4-E4B-it-Q4_K_M-v2

Image-to-Text • 8B • Updated 29 days ago • 158 • 1

tturing/Qwen3-Omni-30B-A3B-Thinking-FP8

Any-to-Any • 32B • Updated 26 days ago • 404 • 1

mlx-community/MiniCPM5-1B-OptiQ-4bit

Text Generation • 0.2B • Updated 4 days ago • 1.13k • 7

w-ahmad/Qwen3.5-9B-GGUF-MoQ-MTP

Text Generation • 9B • Updated 13 days ago • 13.4k • 6

poolside-laguna-hackathon/Piscina-XS.2-GGUF

Text Generation • 33B • Updated 18 days ago • 1.09k • 6

Reza2kn/Cosmos3-Nano-MLX-8bit

Text-to-Image • Updated 15 days ago • 3

InsecureErasure/Z-Image-Turbo-MXFP8

Text-to-Image • Updated 13 days ago • 22 • 1

Vishva007/gemma-4-12B-it-W4A16-AutoRound-GPTQ

1B • Updated 13 days ago • 5.78k • 1

Olicorne/parakeet-tdt-0.6b-v3-smoothquant-onnx

Automatic Speech Recognition • Updated about 3 hours ago • 85 • 1

Simplepotat/gemma-4-31b-it-qat-q4_0-assistant-gguf

Image-Text-to-Text • 0.5B • Updated 8 days ago • 5.36k • 9

Tivaphraen/granite-4.1-8b-Claude-Opus-4.6-Thinking-MAX-gguf

Text Generation • 9B • Updated 9 days ago • 730 • 3

Dotsin/lbm-benchmarking-embeddingsFT

Feature Extraction • Updated 8 days ago • 4

transformerlab/ideogram-4-gguf-q8_0

Text-to-Image • 19B • Updated 8 days ago • 62 • 1

hexera-org/GmshNet-8B-v0.1

Text Generation • 8B • Updated 1 day ago • 15 • 1

hexera-org/GmshNet-8B-v0.1-GGUF

Text Generation • 8B • Updated 1 day ago • 264 • 1

nakue/SmolLM2-1.7B-W4A16-instruct

Text Generation • 2B • Updated 1 day ago • 56 • 1