Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,248

Base only

Active filters: int4

evilbb2/Qwen3-30B-A3B-Instruct-2507-W4A16-g128-RDNA4

31B • Updated 5 days ago • 8

nicosuter/Qwen3.8-27B-AWQ

Image-Text-to-Text • 7B • Updated about 12 hours ago • 2.65k

ResontraAI/voxedge-qwen3-06b-int4-ort

Text Generation • Updated 5 days ago

mobiletransformers/functiongemma-270m-it

Text Generation • Updated 3 days ago

amd/Qwen3.8-27B-fp32-ve-fp32-int4-k_quant-gs128-text-cpu-onnx

Image-Text-to-Text • Updated 5 days ago • 28

Jaidchen/Focus-Red-Int4

Text Generation • 27B • Updated 4 days ago • 142

hotdogs/Qwen3.8-27B-abliterated-AWQ-INT4

Text Generation • 27B • Updated 4 days ago • 367

abhishekchohan/Qwen3.8-27B-GPTQ-INT4

Image-Text-to-Text • 28B • Updated 4 days ago • 428

Svyatoblood/HAGI-DeepSeek-V4-Flash-0731-2M

Text Generation • Updated 4 days ago • 430

Nicolaslas/Rebels_w4a8s

Text-to-Image • Updated 4 days ago • 25

malvavisc0/Qwopus3.5-9B-v3.5-gptq-int4

10B • Updated 4 days ago • 4

cpxavier2/codegemma-7b-it-int4-litertlm

Text Generation • Updated 4 days ago

mobiletransformers/SmolLM2-135M-Instruct

Text Generation • Updated 3 days ago

mobiletransformers/Qwen2.5-0.5B-Instruct

Text Generation • Updated 3 days ago

mobiletransformers/all-MiniLM-L6-v2

Text Classification • Updated 3 days ago

KENIC-1/Qwen3.8-27B-uncensored-w4a8-convrot-ComfyUI

Image-Text-to-Text • Updated 4 days ago

malvavisc0/Qwen3.8-9B-gptq-int4

Text Generation • 10B • Updated 3 days ago • 279

mobiletransformers/distilbert-sst2-english

Text Classification • Updated 3 days ago

XReyRobert/Qwen3.8-27B-W4A16-AutoRound-INT8-Head-Embeddings

Image-Text-to-Text • 6B • Updated 3 days ago • 455

cfao/GLM-5.2-Int4-MSE-Int8Mix

Text Generation • 774B • Updated 3 days ago • 236

JC1DA/Qwen3.8-27B-heretic-ara-W4A16

Text Generation • 6B • Updated 3 days ago • 959

C3DS/CARDS-Wind-Gemma4-12B-GPTQ-w4a16

13B • Updated 3 days ago • 559

ikantkode/Qwen3.5-4B-AWQ-vd

5B • Updated about 16 hours ago • 25

mobiletransformers/gemma-3-270m-it

Text Generation • Updated 3 days ago

Zynerji/Qwen3.8-27B-PristinelyUncensored-HOMEUSER-16-24

Text Generation • 4B • Updated 1 day ago • 650

visible-cx/gemma-4-E2B-CoreAI

Text Generation • Updated 1 day ago

visible-cx/gemma-4-E4B-CoreAI

Text Generation • Updated 1 day ago

visible-cx/Gemma-4-12B-CoreAI

Text Generation • Updated 1 day ago

amd/Qwen3.8-27B-fp16-ve-fp16-int4-k_quant-gs128-text-dml-onnx

Image-Text-to-Text • Updated 1 day ago • 72

visible-cx/Gemma-4-31B-CoreAI

Text Generation • Updated 1 day ago