Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

40

Base only

Active filters: rtn

operationrange/MiniMax-M2.7-8bit

Text Generation • 60B • Updated May 5 • 196 • 2

quantpa/Qwen__Qwen3-4B-Thinking-2507_RTN_w3g128

4B • Updated Jan 21 • 5

quantpa/Qwen__Qwen3-4B-Thinking-2507_RTN_w4g128

4B • Updated Jan 21 • 3

quantpa/Qwen__Qwen3-30B-A3B-Thinking-2507_RTN_w3g128

31B • Updated Jan 21 • 6

quantpa/Qwen__Qwen3-30B-A3B-Thinking-2507_RTN_w4g128

31B • Updated Jan 21 • 4

quantpa/microsoft__Phi-4-reasoning-plus_RTN_w3g128

15B • Updated Jan 21 • 6

quantpa/microsoft__Phi-4-reasoning-plus_RTN_w4g128

15B • Updated Jan 21 • 3

quantpa/zai-org__GLM-Z1-9B-0414_RTN_w3g128

9B • Updated Jan 21 • 5

quantpa/zai-org__GLM-Z1-9B-0414_RTN_w4g128

9B • Updated Jan 21 • 6

tonimartir/gpt-oss-20b-onnx-cuda-rtn-gpu

Text Generation • Updated Feb 9 • 4

tonimartir/gpt-oss-20b-onnx-generic-rtn-cpu

Text Generation • Updated Feb 9

necroyancer/gemma-4-31B-it-NVFP4-turbo-vision

Image-Text-to-Text • 33B • Updated Apr 26 • 1.64k • 4

nerkyor/Qwen3.6-35B-A3B-NVFP4-v8-RTN

Text Generation • Updated May 11 • 75 • 1

nerkyor/Qwen3.6-27B-NVFP4-v8-RTN

Text Generation • 16B • Updated May 11 • 45

WaveCut/gemma-4-26B-A4B-it-heretic-W4A16-G64-RTN-vllm

Image-Text-to-Text • 27B • Updated 16 days ago • 173

88plug/Nemotron-3-Nano-30B-A3B-W4A16

Text Generation • 33B • Updated 18 days ago • 2.55k

morriszjm/Qwen3-30B-A3B-RTN-W4A16-g128

Text Generation • 31B • Updated Jun 4 • 4

vio1ator/Nex-N2-mini-FP8-RTN

35B • Updated Jun 7 • 294

WaveCut/Qwopus3.6-27B-Coder-FP8-W4A16-G64-RTN-vllm

Image-Text-to-Text • 6B • Updated Jun 14 • 114 • 2

qwertz92/ibm-granite-speech-4.1-2b-nar-q4-rtn-onnx

Automatic Speech Recognition • Updated Jun 24

TrNi/efficient-cube3d

Text-to-3D • Updated 18 days ago • 8

casperhansen/Qwen3.6-35B-A3B-INT4-RTN

Image-Text-to-Text • 37B • Updated about 1 month ago • 461

sahilchachra/Agents-A1-W4A16

Image-Text-to-Text • 35B • Updated 1 day ago • 2.62k

sahilchachra/Laguna-XS-2.1-W4A16

Text Generation • 34B • Updated 28 days ago • 610 • 2

avtc/Hy3-GPTQ-RTN-4bit-tp8

Text Generation • 295B • Updated 3 days ago • 466 • 3

Hakureirm/rwkv7-sglang-w4rtn-1.5b

Text Generation • 0.9B • Updated 21 days ago

Hakureirm/rwkv7-sglang-w4rtn-7.2b

Text Generation • 4B • Updated 21 days ago

avtc/Hy3-autoround-RTN-4bit-tp8-ep

Text Generation • 44B • Updated 22 days ago • 78 • 1

hongweimeng/Qwen3.5-35B-A3B-AWQ-INT4

Image-Text-to-Text • Updated 15 days ago • 44

rapatel0/Ornith-1.0-35B-RTN-AWQ-asym

Text Generation • 6B • Updated 19 days ago • 56