Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,256

Base only

Active filters: int8

transformerlab/ideogram-4-int8-w8a8

Text-to-Image • Updated 8 days ago • 6

Abiray/L2P-model-1k-merge-INT8

Text-to-Image • Updated 25 days ago • 15

Dafisns/whisper-turbo-multilingual-cf-ct2

Automatic Speech Recognition • Updated Nov 30, 2025 • 15 • 1

EricRollei/Hunyuan_Image_3_Int8

Text-to-Image • 83B • Updated Nov 27, 2025 • 9 • 3

berryber09/Wan2.2-I2V-14B-INT8-W8A8

Image-to-Video • Updated Feb 18 • 5

EricRollei/HunyuanImage-3.0-Instruct-Distil-INT8-v2

Text-to-Image • 83B • Updated Feb 22 • 61 • 7

sonic-speech/parakeet-tdt-0.6b-v3-int8

Automatic Speech Recognition • 0.2B • Updated Mar 8 • 270 • 2

collin-park/Qwen3-VL-Embedding-8B-W8A8

Image-Text-to-Text • 9B • Updated Mar 18 • 11.2k • 1

AMAImedia/Qwen3.5-35B-A3B-Darwin-Opus-NOESIS-AWQ-INT8

Text Generation • 37B • Updated Apr 26 • 19 • 11

Minachist/Qwen3.6-27B-INT8-AutoRound

Image-Text-to-Text • 13B • Updated about 1 month ago • 14.5k • 17

nameistoken/Qwen3.6-27B-Quark-W8A8-INT8

Image-Text-to-Text • 27B • Updated May 13 • 2.57k • 6

curiositytech/runeward-small-onnx-int8

Token Classification • Updated May 11 • 13 • 2

trsdn/parakeet-tdt-0.6b-v3-htp-int8-8s

Automatic Speech Recognition • Updated 6 days ago • 1

Tamil78/MiniLM-L12-finetuned-int8

Feature Extraction • Updated 3 days ago • 73 • 1

aidendle94/diffusiongemma-26B-A4B-it-INT8-dynamic

Text Generation • 26B • Updated 6 days ago • 3.51k • 1

Arthur920/staleguard

Text Classification • Updated 1 day ago • 21 • 1

premmm/minilm-spam-int8

Text Classification • Updated 4 days ago • 28 • 1

premmm/xlm-roberta-spam-int8

Text Classification • Updated 4 days ago • 27 • 1

LumeData/HandleAtlas-166m-CPU

Token Classification • Updated 4 days ago • 5 • 1

egomnia/emma-3

Text Generation • Updated about 6 hours ago • 2

egomnia/emma-4

Text Generation • Updated about 6 hours ago • 2

egomnia/emma-5

Text Generation • Updated about 6 hours ago • 2

Intel/distilbert-base-uncased-finetuned-sst-2-english-int8-static-inc

Text Classification • Updated Jun 27, 2023 • 54 • 6

INC4AI/bert-base-uncased-mrpc-int8-qat-inc

Text Classification • Updated Mar 21, 2024 • 11 • 1

INC4AI/albert-base-v2-sst2-int8-static-inc

Text Classification • Updated Mar 22, 2024 • 8

INC4AI/bert-base-uncased-mrpc-int8-static-inc

Text Classification • Updated Mar 21, 2024 • 33

INC4AI/roberta-base-mrpc-int8-static-inc

Text Classification • Updated Mar 21, 2024 • 9

echarlaix/distilbert-sst2-inc-dynamic-quantization-magnitude-pruning-0.1

Text Classification • Updated Jun 13, 2023 • 27

echarlaix/t5-small-int8-dynamic

Translation • Updated Oct 26, 2023 • 11 • 4

echarlaix/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic

Text Classification • Updated Jun 13, 2023 • 429 • 1