Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,850

Base only

Active filters: fp8

Imrishav87639/DeepSeek-V4-Flash-Base

292B • Updated Jun 2 • 5

mradermacher/GLM-5.1-Abliterated-i1-GGUF

0.3B • Updated Jun 4 • 14

anhnguyen002/DeepSeek-V4-Pro

Text Generation • 862B • Updated Jun 2 • 3

inclusionAI/Ling-2.6-flash-base

Text Generation • 108B • Updated Jun 22 • 311 • 14

spellbound-eng/hy3-spellbound-simpo-r256-b10-g3-sft0p1-lr2e-6-step303-merged-fp8

295B • Updated Jun 2

inclusionAI/Ling-2.6-1T-base

Text Generation • 1T • Updated Jun 22 • 142 • 13

RedHatAI/Mellum2-12B-A2.5B-Thinking-FP8-Dynamic

12B • Updated Jun 12 • 30

estebanwito/MiMo-V2.5-Pro

Text Generation • 1T • Updated Jun 2 • 5

Abiray/Wan22_Bernini_FP8_Scaled

Image-Text-to-Video • Updated Jun 2 • 24

Rp2609/DeepSeek-V4-Pro

Text Generation • 862B • Updated Jun 2 • 2

hchitte/DeepSeek-V4-Flash-baseline-nvfp4

Text Generation • 158B • Updated Jun 2 • 5

jrrhf/DeepSeek-V4-Flash

Text Generation • 158B • Updated Jun 3 • 5

INSAIT-Institute/MamayLM-Gemma-3-27B-IT-v2.0-FP8-dynamic

Image-Text-to-Text • 29B • Updated Jun 3 • 77 • 2

wdfgyuagguf/DeepSeek-V4-Pro-NVFP4-FREE

Text Generation • 910B • Updated Jun 3 • 7 • 1

linustws/MiMo-V2.5

311B • Updated Jun 3 • 4

Asmita2682hshs/DeepSeek-V4-Pro

Text Generation • 862B • Updated Jun 3 • 6

janfeddersen-wq/DeepSeek-V4-Flash-ega

Text Generation • 158B • Updated Jun 3 • 1

bahadirakdemir/gemma-4-12B-it-text-fp8

Text Generation • 12B • Updated Jun 3 • 850 • 2

bahadirakdemir/gemma-4-12B-it-assistant-fp8

Text Generation • 0.4B • Updated Jun 3 • 107 • 2

Rezaul66877/DeepSeek-V4-Pro

Text Generation • 862B • Updated Jun 4 • 3

Rifky/LFM2.5-8B-A1B-FP8

8B • Updated Jun 4 • 269 • 2

coolthor/gemma-4-12B-it-FP8-dynamic

Any-to-Any • 12B • Updated 11 days ago • 4.07k • 1

morriszjm/Qwen3-30B-A3B-FP8-Dynamic

Text Generation • 31B • Updated Jun 4 • 5 • 1

vrfai/gemma-4-12B-it-fp8

Text Generation • 12B • Updated Jun 6 • 465 • 3

GermGix/Mistral-Medium-3.5-128B

128B • Updated Jun 4 • 5

khaduyen1993/qwen3.6-27b

Image-Text-to-Text • 28B • Updated Jun 4 • 12

palmfuture/gemma-4-12B-it-FP8

Any-to-Any • 12B • Updated Jun 4 • 63 • 1

RedHatAI/NVIDIA-Nemotron-3-Ultra-550B-A55B-FP8-block

Text Generation • 561B • Updated 19 days ago • 10.2k

neuregex/Bernini-R-fp8

Text-to-Video • 14B • Updated Jun 5 • 1

senapati484/Qwen3.6-27B-FP8

Image-Text-to-Text • 28B • Updated Jun 5 • 12