Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,814

Base only

Active filters: fp8

joao4685/DeepSeek-V4-Flash

Text Generation • 158B • Updated 8 days ago • 21

ckoh04/deepseek-v3-pruned-8experts-mtp

Text Generation • 40B • Updated 7 days ago • 41

prithivMLmods/Fara1.5-9B-GGUF

Image-Text-to-Text • 9B • Updated 7 days ago • 873 • 1

prithivMLmods/Fara1.5-27B-FP8

Image-Text-to-Text • 27B • Updated 8 days ago • 161 • 1

prithivMLmods/Fara1.5-9B-FP8

Image-Text-to-Text • 9B • Updated 8 days ago • 625 • 1

prithivMLmods/Fara1.5-4B-FP8

Image-Text-to-Text • 5B • Updated 8 days ago • 96 • 1

thoratsr7/MiMo-V2.5

Text Generation • 311B • Updated 8 days ago • 20

thoratsr7/MiMo-V2-Flash

Text Generation • 310B • Updated 8 days ago • 17

NullSense/Nanbeige4.2-3B-FP8-Dynamic

Text Generation • 4B • Updated 7 days ago • 860

NullSense/Nanbeige4.2-3B-NVFP4A16

Text Generation • 3B • Updated 7 days ago • 201

inference-optimization/Qwen3.5-397B-A17B-FP8-dynamic-mtp-head

Image-Text-to-Text • 404B • Updated 8 days ago • 115

enoky/StereoCrafter2-FP8

Updated 7 days ago • 17

ep219/GLM-5.2-colibri-int4-with-int8-mtp

Updated 7 days ago • 24

Dayafterhereafter/DeepSeek-R1

Text Generation • 685B • Updated 7 days ago • 27

soyrsoyr/gemma-4-12b-it-FP8-Dynamic

Text Generation • 13B • Updated 7 days ago • 26

prometheusAIR/Cosmos3-Super-Image2Video-4Step-FP8

Image-to-Video • Updated 6 days ago • 72

Scrappy-Doo/DeepSeek-V4-Pro

Text Generation • 862B • Updated 5 days ago • 1.53k

ckoh04/qwen3-235b-a22b-fp8-pruned-8experts

Text Generation • 22B • Updated 7 days ago • 40

ckoh04/deepseek-v4-flash-pruned-6experts

Text Generation • 11B • Updated 7 days ago • 49

ulmentflam/gpt2-774m-fineweb-fp8-mojo

Text Generation • 0.8B • Updated 7 days ago • 33

ckoh04/glm-5.2-fp8-pruned-8experts

Text Generation • 42B • Updated 7 days ago • 27

akpsahan/MiMo-V2.5-Pro

Text Generation • 1T • Updated 7 days ago • 32

Pq234/DeepSeek-V4-Flash

Text Generation • 158B • Updated 6 days ago • 22

AgentAnon/flux-klein-9b-Biglove-Collection

Text-to-Image • 9B • Updated 6 days ago • 4.05k

ajh-code/Mage-Flow-Turbo-NVFP4-Balanced-AJH

Text-to-Image • 3B • Updated 6 days ago • 63

777Radik/Qwen-Image-2512-FP8-E4M3FN

Text-to-Image • 20B • Updated 6 days ago • 62

777Radik/Qwen-Image-Cyrillic-Config

Updated 6 days ago

Umbasa/DeepSeek-V4-Pro-DSpark-UMBASA-V1

Text Generation • 889B • Updated 6 days ago • 18

ajh-code/Mage-Flow-Turbo-XPO3-NVFP4

Text-to-Image • Updated about 21 hours ago • 172

hangxian/Qwen3.5-27B-FP8-PerChannel

Text Generation • 27B • Updated 5 days ago • 26