Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,810

Base only

Active filters: fp8

urs-rs/gemma-4-26B-A4B-it-FP8-DYNAMIC

Image-Text-to-Text • 27B • Updated 17 days ago • 90

Valent1qw/DeepSeek-V4-Flash-DSpark-Abliterated

165B • Updated 22 days ago • 103 • 1

Quiho/WAI-illustrious-HSWQ_v17.0_base_checkpoint

Updated 21 days ago • 178

Artificial-Development-Studios/LongCat-2.0-FP8

Text Generation • 1.8T • Updated 21 days ago • 11

dshive/DeepSeek-V4-Flash

Text Generation • 158B • Updated 21 days ago • 120

dshive/DeepSeek-V4-Pro

Text Generation • 862B • Updated 21 days ago • 118

dshive/DeepSeek-V4-Pro-DSpark

Text Generation • 889B • Updated 21 days ago • 125

ckoh04/DeepSeek-V4-Pro-active-slice-6experts

Text Generation • 52B • Updated 21 days ago • 196

dshive/MiniMax-M2.7

Text Generation • 229B • Updated 21 days ago • 136

dshive/MiMo-V2.5-Pro

Text Generation • 1T • Updated 21 days ago • 137

dshive/MiMo-V2.5-Pro-FP4-DFlash

Text Generation • 554B • Updated 21 days ago • 146

dshive/MiMo-V2.5

Text Generation • 311B • Updated 21 days ago • 141

furiosa-ai/Meta-Llama-3.1-8B-Instruct-FP8-dynamic

Text Generation • 8B • Updated 6 days ago • 186

N8Programs/Qwen3.6-35B-A3B-AntiLoop-NVFP4

Text Generation • 19B • Updated 21 days ago • 1.14k • 4

amanwalksdownthestreet/DeepSeek-R1-Distill-Llama-70B-MXFP8

Text Generation • 73B • Updated 18 days ago • 46

jtchen0528/gemma-4-31B-it-FP8

Image-Text-to-Text • 31B • Updated 16 days ago • 2

cabelo/Qwen3-Coder-Next-FP8

Text Generation • 80B • Updated 21 days ago • 39

UnfortunateAttractive/DeepSeek-V4-Flash-Base-quantization

292B • Updated 21 days ago • 20 • 1

mlx-community/Qwen3.6-35B-A3B-AntiLoop-NVFP4

Text Generation • 7B • Updated 21 days ago • 1.93k • 3

muller1789798/Qwen3-VL-4B-Instruct-FP8

Image-Text-to-Text • 5B • Updated 21 days ago • 18

iceDonkey/GLM-5.2-FP8

Text Generation • 753B • Updated 21 days ago • 34

H3C-MKP/Hy3-FP8

Text Generation • 299B • Updated 20 days ago • 35

pamohlyakov-work/GigaChat3.1-10B-A1.8B-bf16

Text Generation • 11B • Updated 20 days ago • 559

zhangpengshou/DeepSeek-V4-Flash

Text Generation • 158B • Updated 20 days ago • 151

williamliao/Qwen3.6-27B-Unsloth-NVFP4-Experimental-GGUF

Text Generation • 27B • Updated 10 days ago • 4.91k • 1

fivetech/MiMo-V2.5-colibri-peng-int4

Updated 11 days ago • 322 • 2

ALXOPENSOURCE/lingbot-video-1.3b-fp8

Text-to-Video • 1B • Updated 20 days ago • 146 • 8

ckoh04/MiMo-V2.5-Pro-FP4-DFlash-pruned-8experts

Text Generation • 34B • Updated 20 days ago • 235

CodeStrux-Tech/tac-1-fp8-dynamic

Text Generation • 4B • Updated 20 days ago • 39

Quatfit/Quatfit-Mini-FP8

Image-Text-to-Text • 8B • Updated 18 days ago • 80 • 1