Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

175

Base only

Active filters: cpu-inference

priyankapathak/gemma-4-E4B-it-Q6_K

Text Generation • 8B • Updated Apr 29 • 7

OkeyMetaLtd/Reframr-RFM-v1-Base

Text Generation • 44.3M • Updated May 3 • 3

amd/Qwen2.5-VL-7B-Instruct-da8w8-torchao-v0.16.0

Image-Text-to-Text • Updated May 4 • 3

amd/Phi-4-da8w8-torchao-v0.16.0

Text Generation • Updated May 4 • 87

amd/Qwen3-14B-Instruct-da8w8-torchao-v0.16.0

Text Generation • Updated May 4 • 78

curiositytech/uran-stt-base

Automatic Speech Recognition • Updated May 7 • 2 • 2

mahiyama/splade-ja-310m-onnx-int8

Feature Extraction • Updated May 8 • 4

vmo247/VieNeu-TTS-v2-Turbo-GGUF

Text-to-Speech • 0.1B • Updated May 9 • 59

OkeyMetaLtd/Reframr-RFM-v2-Base

Text Generation • 0.3B • Updated May 9 • 3

saadxsalman/Q-SS-0.5B-Reasoning-Math-GGUF

Text Generation • 0.5B • Updated May 13 • 97

changcheng967/cpuflow-v5-ln

Text Generation • Updated May 18

changcheng967/cpuflow-v97-memory

Text Generation • Updated May 18

changcheng967/cpuflow-v9-ram

Text Generation • Updated May 18

changcheng967/cpuflow-v8-discrete

Text Generation • Updated May 18

MitzMitz/Llama-ChemLink-Parser-8B-MTYS

Updated 4 days ago

mesklintech/mesko-llm-7b

Updated May 19 • 1

prokopsafranek/gemma-4-26B-A4B-it-GGUF

Text Generation • 25B • Updated Jun 4 • 201 • 1

Laborator/kaggle-hackathon-birdclef-2026

Audio Classification • Updated May 23

amd/gpt-oss-20b-BF16-da8w8-torchao-v0.17.0

Text Generation • 21B • Updated 25 days ago • 119

amd/granite-4.0-h-tiny-da8w8-torchao-v0.17.0

Text Generation • 7B • Updated 25 days ago • 14

amd/InternVL3-8B-da8w8-torchao-v0.17.0

Image-Text-to-Text • Updated May 27 • 19

amd/Mistral-7B-v0.1-da8w8-torchao-v0.17.0

Text Generation • 7B • Updated 25 days ago • 20

amd/Qwen3-30B-A3B-da8w8-torchao-v0.17.0

Text Generation • 31B • Updated May 27 • 14

amd/Qwen3-VL-8B-Instruct-da8w8-torchao-v0.17.0

Image-Text-to-Text • 9B • Updated May 27 • 30

amd/Qwen2.5-VL-7B-Instruct-da8w8-torchao-v0.17.0

Image-Text-to-Text • Updated May 27 • 264

amd/gpt-oss-20b-BF16-w8a8-llmcompressor-v0.10.0.2

Text Generation • 21B • Updated Jun 3 • 5.84k

amd/Llama-3.1-8B-Instruct-da8w8-torchao-v0.17.0

Text Generation • 8B • Updated 25 days ago • 75

amd/Llama-3.1-8B-Instruct-w4a16-tao-symchannel-torchao-v0.17.0

Text Generation • 8B • Updated May 27 • 13

amd/Phi-4-reasoning-plus-w4a16-tao-symchannel-torchao-v0.17.0

Text Generation • 15B • Updated May 27 • 11

amd/Llama-3.1-8B-Instruct-w4a16-tao-symgroup-torchao-v0.17.0

Text Generation • 8B • Updated May 27 • 80