Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

139

Base only

Active filters: aqlm

dbw6/Qwen3-30B-A3B-Instruct-2507-AQLM-4Bit-4x8-hf

Text Generation • 16B • Updated Mar 30 • 39 • 1

dbw6/Mixtral-8x7B-AQLM-2Bit-2x8-hf

Text Generation • 12B • Updated Mar 30 • 43 • 2

dbw6/Mixtral-8x7B-AQLM-4Bit-4x8-hf

Text Generation • 23B • Updated Mar 30 • 46

dbw6/Qwen3-30B-A3B-Instruct-2507-AQLM-2Bit-2x8-hf

Text Generation • 8B • Updated Apr 6 • 27 • 2

dbw6/Llama-2-13b-AQLM-4Bit-4x8-hf

Text Generation • 7B • Updated Apr 5 • 9

dbw6/Llama-2-7b-AQLM-4Bit-4x8-hf

Text Generation • 4B • Updated Apr 5 • 138

kennedyian94/Llama-3.2-3B-AQLM-OA-EM-2Bit-2x8

Text Generation • Updated Apr 14 • 626 • 1

kennedyian94/Qwen-2.5-3B-AQLM-OA-EM-2Bit-2x8

Text Generation • 1B • Updated 12 days ago • 638 • 1

kennedyian94/Llama-3.1-8B-AQLM-OA-EM-2Bit-2x8

Text Generation • Updated Apr 14 • 601 • 1

TheStageAI/gemma-4-E2B-it

Image-Text-to-Text • Updated 29 days ago • 1.34k • 4

TheStageAI/gemma-4-E4B-it

Image-Text-to-Text • Updated 29 days ago • 2.14k • 9

TheStageAI/gemma-4-E2B-it-qat

Image-Text-to-Text • Updated 20 days ago • 100

TheStageAI/gemma-4-E4B-it-qat

Image-Text-to-Text • Updated 20 days ago • 77

dbw6/Llama-3.1-8B-Instruct-AQLM-8bit-8x8

Text Generation • 8B • Updated 8 days ago • 10

aquaman164/GLM-5.2-VQ-Arith

Text Generation • 52B • Updated 4 days ago • 179

aquaman164/GLM-5.2-VQ-1.7bit-JA

Text Generation • 49B • Updated 3 days ago • 234

yw223/Meta-Llama-3.1-8B-Instruct-AQLM-2bit

Text Generation • Updated 2 days ago • 14

yw223/Meta-Llama-3.1-8B-Instruct-AQLM-3bit

Text Generation • Updated 2 days ago • 20

yw223/Meta-Llama-3.1-8B-Instruct-AQLM-4bit

Text Generation • Updated 2 days ago • 11