Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,844

Base only

Active filters: fp8

candyhead/unsloth-Qwen3-14B-FP8

Text Generation • 15B • Updated 14 days ago • 16

sasameden/DeepSeek-V4-Pro

Text Generation • 862B • Updated 14 days ago • 18

w3ss/flux1-schnell-fp8-flux

Text-to-Image • 12B • Updated 13 days ago • 16

KoolKatC/DeepSeek-V4-Pro

Text Generation • 862B • Updated 13 days ago • 16

brandonmusic/deepseek-v4-flash-dspark-merged

165B • Updated 13 days ago • 13

PiTtawat9/DeepSeek-V4-Flash-Base

292B • Updated 13 days ago • 20

PiTtawat9/DeepSeek-V4-Pro

Text Generation • 862B • Updated 13 days ago • 21

SpelingBee/qwen3.6-27b-korean-fp8-dynamic

Image-Text-to-Text • 27B • Updated 13 days ago • 36

aidendle94/GLM-5.2-Hybrid-FP8-MXFP4

425B • Updated 7 days ago • 241 • 2

yulissa1974/MiMo-V2.5-Pro

Text Generation • 1T • Updated 12 days ago • 21

sammysun0711/Llama-2-70b-hf-fp8_quantized

69B • Updated 12 days ago • 17

GaelicThunder/Qwen3.5-122B-A10B-heretic-hybrid-int4fp8

Text Generation • 21B • Updated 12 days ago • 326

Brooooooklyn/Agents-A1-nvfp4-mlx

Text Generation • 24B • Updated 11 days ago • 61

Brooooooklyn/Ornith-1.0-35B-nvfp4-mlx

Text Generation • 24B • Updated 11 days ago • 578

Brooooooklyn/Qwen-AgentWorld-35B-A3B-nvfp4-mlx

Text Generation • 24B • Updated 11 days ago • 229

Brooooooklyn/Qwen3.6-27B-NVFP4-mlx

Image-Text-to-Text • 27B • Updated 11 days ago • 1.31k • 1

ckoh04/deepseek-v3-pruned-8experts-clean

Text Generation • 37B • Updated 11 days ago • 48

Altworld/Astrea-R8-Chat-9B-FP8

Image-Text-to-Text • 9B • Updated 11 days ago • 32

thongfamilynguyen1126/DeepSeek-R1-0528

Text Generation • 685B • Updated 11 days ago • 13

el1191/Qwen3.6-27B-FP8

Image-Text-to-Text • 28B • Updated 11 days ago • 16

0ppxnhximxr/Motif-3-Beta-FP8

Text Generation • 315B • Updated 10 days ago • 98 • 5

poppingstar/DeepSeek-V4-Flash

Text Generation • 158B • Updated 11 days ago • 16

poppingstar/DeepSeek-V4-Flash-GGUF

284B • Updated 11 days ago • 771

poppingstar/Hy3-FP8

Text Generation • 299B • Updated 11 days ago • 12

SinclairSchneider/DeepSeek-V4-Flash-W4A16-FP8-MTP-Ada

Text Generation • 51B • Updated 8 days ago • 79

PhalaCloud/GLM-5.2-W4A8-CT

Text Generation • 116B • Updated 10 days ago • 48

Scrappy-Doo/DeepSeek-R1

Text Generation • 685B • Updated 9 days ago • 737

Isaacasimov009/GLM-5.2-colibri-int4-with-int8-mtp

Updated 10 days ago • 18

erenyeager-1/deepseek-v4_2

Text Generation • 0.2B • Updated 10 days ago • 16

Tvheadbot1991/GLM-5.2-colibri-int4-with-int8-mtp

Updated 10 days ago • 14