Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,907

Base only

Active filters: fp8

NullSense/Nanbeige4.2-3B-NVFP4-FP8-LoopShield

Text Generation • 4B • Updated 11 days ago • 597 • 2

NullSense/Nanbeige4.2-3B-NVFP4A16

Text Generation • 3B • Updated 11 days ago • 217

inference-optimization/Qwen3.5-397B-A17B-FP8-dynamic-mtp-head

Image-Text-to-Text • 404B • Updated 12 days ago • 120

enoky/StereoCrafter2-FP8

Updated 12 days ago • 19

ep219/GLM-5.2-colibri-int4-with-int8-mtp

Updated 12 days ago • 27

rdtand/Laguna-S-2.1-prismaquant-gridbook-6bit-vllm

Text Generation • 85B • Updated 7 days ago • 442 • 6

Dayafterhereafter/DeepSeek-R1

Text Generation • 685B • Updated 12 days ago • 29

soyrsoyr/gemma-4-12b-it-FP8-Dynamic

Text Generation • 13B • Updated 12 days ago • 37

prometheusAIR/Cosmos3-Super-Image2Video-4Step-FP8

Image-to-Video • Updated 11 days ago • 76

Scrappy-Doo/DeepSeek-V4-Pro

Text Generation • 862B • Updated 10 days ago • 1.58k

ckoh04/qwen3-235b-a22b-fp8-pruned-8experts

Text Generation • 22B • Updated 11 days ago • 43

ckoh04/deepseek-v4-flash-pruned-6experts

Text Generation • 11B • Updated 11 days ago • 69

ckoh04/glm-5.2-fp8-pruned-8experts

Text Generation • 42B • Updated 11 days ago • 507

akpsahan/MiMo-V2.5-Pro

Text Generation • 1T • Updated 11 days ago • 34

AIA-YSC/GLM-5.2-colibri-int4-with-int8-mtp

Updated 11 days ago • 42 • 1

Pq234/DeepSeek-V4-Flash

Text Generation • 158B • Updated 11 days ago • 24

AgentAnon/flux-klein-9b-Biglove-Collection

Text-to-Image • 9B • Updated 11 days ago • 10.3k

ajh-code/Mage-Flow-Turbo-NVFP4-Balanced-AJH

Text-to-Image • 3B • Updated 10 days ago • 64

777Radik/Qwen-Image-2512-FP8-E4M3FN

Text-to-Image • 20B • Updated 10 days ago • 62

777Radik/Qwen-Image-Cyrillic-Config

Updated 10 days ago

Umbasa/DeepSeek-V4-Pro-DSpark-UMBASA-V1

Text Generation • 889B • Updated 10 days ago • 20

Umbasa/DeepSeek-V4-Pro-Base-UMBASA-V1

1.6T • Updated 10 days ago • 19 • 1

ajh-code/Mage-Flow-Turbo-XPO3-NVFP4

Text-to-Image • Updated 5 days ago • 3.79k

hangxian/Qwen3.5-27B-FP8-PerChannel

Text Generation • 27B • Updated 10 days ago • 28

Ddavidich/LOMONOSOV-ZENIT-27B-1M-INDEV

Text Generation • 16B • Updated 5 days ago • 544 • 1

hyperhuzaifa/GLM-5.2-colibri-int4-with-int8-mtp

Updated 9 days ago • 49

goodcccc/dsv4-flash-ablit-patched

Updated 9 days ago • 464

shyamwertyajm/SR.DeepSeek-R1-Full-Backup

Updated 9 days ago • 193

edougawa/ThinkingCap-Qwen3.6-27B-Abliterix-FP8

Image-Text-to-Text • 27B • Updated 9 days ago • 38

icdevelop/pai1-medgemma-27b-fp8

Image-Text-to-Text • 27B • Updated 7 days ago