Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,851

Base only

Active filters: fp8

furiosa-ai/Qwen3-30B-A3B-Thinking-2507-FP8

Text Generation • 31B • Updated 11 days ago • 693

furiosa-ai/Qwen3-Coder-30B-A3B-Instruct-FP8

Text Generation • 31B • Updated 11 days ago • 822

furiosa-ai/Qwen3-30B-A3B-Instruct-2507-FP8

Text Generation • 31B • Updated 11 days ago • 1.46k

Soofi-Project/Soofi-S-Instruct-Preview-FP8

Text Generation • 32B • Updated 15 days ago • 895 • 1

Soofi-Project/Soofi-S-Isar-Preview-FP8

Text Generation • 32B • Updated 15 days ago • 73

Soofi-Project/Soofi-S-Rhine-Preview-FP8

Text Generation • 32B • Updated 15 days ago • 374 • 1

HYHPING2023/checkpoint-fp8-hf

35B • Updated Jun 29 • 5

amanwalksdownthestreet/Hermes-4-70B-MXFP8

Text Generation • 73B • Updated 29 days ago • 33

VIDraft/JGOS-31B-FP8

Image-Text-to-Text • 31B • Updated 11 days ago • 24 • 1

Soofi-Project/Soofi-S-Instruct-Preview-EntQuant-2bit

Text Generation • 12B • Updated 15 days ago • 59

Soofi-Project/Soofi-S-Instruct-Preview-EntQuant-3bit

Text Generation • 14B • Updated 15 days ago • 24

Soofi-Project/Soofi-S-Instruct-Preview-EntQuant-4bit

Text Generation • 17B • Updated 15 days ago • 7

Soofi-Project/Soofi-S-Isar-Preview-EntQuant-2bit

Text Generation • 12B • Updated 15 days ago • 21

Soofi-Project/Soofi-S-Isar-Preview-EntQuant-3bit

Text Generation • 14B • Updated 15 days ago • 23

Soofi-Project/Soofi-S-Isar-Preview-EntQuant-4bit

Text Generation • 17B • Updated 15 days ago • 15

Soofi-Project/Soofi-S-Rhine-Preview-EntQuant-2bit

Text Generation • 12B • Updated 15 days ago • 2

Soofi-Project/Soofi-S-Rhine-Preview-EntQuant-3bit

Text Generation • 14B • Updated 15 days ago • 17

Soofi-Project/Soofi-S-Rhine-Preview-EntQuant-4bit

Text Generation • 17B • Updated 15 days ago • 2

inference-optimization/Qwen3-8B-FP8-Dynamic

Text Generation • 8B • Updated Jun 29 • 11

Jackrong/Qwopus3.6-35B-A3B-Coder-FP8

Text Generation • 36B • Updated Jun 30 • 14.6k • 11

furiosa-ai/Qwen3-30B-A3B-FP8

Text Generation • 31B • Updated 11 days ago • 418

indigoskyai/DeepSeek-V3

Text Generation • 685B • Updated Jun 29 • 11

harrisonvanderbyl/GLM-4.6-FP8

Text Generation • 357B • Updated Jun 30 • 69

cusiman/Huihui-Qwen3-VL-4B-Instruct-abliterated-comfy

Image-Text-to-Text • Updated Jun 29 • 1

indigoskyai/DeepSeek-V3.2

Text Generation • 685B • Updated Jun 30 • 44

indigoskyai/DeepSeek-R1

Text Generation • 685B • Updated Jun 30 • 9

Lowkeyss/GLM-5.2-ablated

Text Generation • 743B • Updated Jun 30 • 25

shshdbf/DeepSeek-V3.2

Text Generation • 685B • Updated Jun 30 • 47

JasonW2025/Qwen3.6-27B-PrismaQuant-5.1bit-Hybrid

Text Generation • 18B • Updated 22 days ago • 9

INCModelSharing/DeepSeek-V4-Pro-DSpark-MXFP4-Mixed-CT-AutoRound

Text Generation • 889B • Updated Jun 30 • 33 • 1