Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

163

Base only

Active filters: mla

Quazim0t0/Byrne-100M-Ultra-MC

Text Generation • 0.1B • Updated about 11 hours ago • 118 • 3

mudler/GLM-4.7-Flash-APEX-GGUF

30B • Updated 4 days ago • 5.74k • 16

Inferact/Kimi-K3-DSpark

Text Generation • 4B • Updated 23 days ago • 41.1k • 55

Eraly-ml/Kimi-K3-0.40B-Kazakh-CPT-59M

Text Generation • 0.4B • Updated 23 days ago • 136 • 1

gaber/kimi-k3-dspark-gguf

Text Generation • 2B • Updated 21 days ago • 2.72k • 1

ljupco/Ling-3.0-flash-GGUF

Text Generation • 127B • Updated 9 days ago • 330 • 2

Abhisingh-18/Sutra-1.3B-Chat

Text Generation • 1B • Updated about 2 hours ago • 459 • 1

Jon-Nielsen/DeepSeek-V4-Flash-0731-MXFP4-INT8

Text Generation • 159B • Updated 6 days ago • 157 • 1

Jon-Nielsen/DeepSeek-V4-Flash-0731-Abliterated-MXFP4-INT8

Text Generation • 159B • Updated 5 days ago • 146 • 1

FINAL-Bench/Aether-6B-11Attn-base

Text Generation • 6B • Updated about 1 month ago • 2k • 30

espnet/xeus

Automatic Speech Recognition • Updated Jun 17, 2025 • 61 • 151

bird-of-paradise/deepseek-mla

Text Generation • Updated Feb 27, 2025 • 20

BarraHome/llama3.2-1b-mla

1B • Updated Feb 24, 2025 • 14 • 4

erax-ai/EraX-LLaMA3.1-8B-DeepSeekR1-MLA-MoE-Raw

Text Generation • 13B • Updated Mar 10, 2025 • 21 • 15

Khawn2u/llama3.2-1b-mla-Q4_K_M-GGUF

1B • Updated Mar 10, 2025 • 27

ubergarm/DeepSeek-V3-0324-GGUF

Text Generation • 672B • Updated Jul 10, 2025 • 38 • 36

ubergarm/DeepSeek-R1T-Chimera-GGUF

Text Generation • 672B • Updated Jul 10, 2025 • 25 • 1

ubergarm/DeepSeek-R1-0528-GGUF

Text Generation • 672B • Updated Jul 19, 2025 • 105 • 52

anikifoss/DeepSeek-R1-0528-DQ4_K_R4

Text Generation • 672B • Updated Nov 27, 2025 • 26 • 9

LipingWang/spaCy-NER-MLA-Citations

Updated Jun 4, 2025

ubergarm/DeepSeek-TNG-R1T2-Chimera-GGUF

Text Generation • 672B • Updated Jul 11, 2025 • 11 • 6

ubergarm/Kimi-K2-Instruct-GGUF

Text Generation • 1T • Updated Jul 22, 2025 • 391 • 22

anikifoss/Kimi-K2-Instruct-DQ4_K

Text Generation • 1T • Updated Nov 27, 2025 • 11 • 4

tachyphylaxis/DeepSeek-R1-0528-GGUF

Text Generation • 672B • Updated Jul 18, 2025 • 16

gghfez/DeepSeek-V3-0324-IQ3_KS

Text Generation • 672B • Updated Jul 26, 2025 • 6 • 2

gghfez/DeepSeek-R1-Zero-IQ2_KS

Text Generation • 672B • Updated Oct 19, 2025 • 10

gghfez/DeepSeek-R1-Zero-IQ3_KS

Text Generation • 672B • Updated Oct 19, 2025 • 29

gghfez/DeepSeek-V3-0324-IQ2_KS

Text Generation • 672B • Updated Oct 18, 2025 • 32

gghfez/DeepSeek-V3.1-IQ2_KS

Text Generation • 672B • Updated Aug 22, 2025 • 6

ubergarm/DeepSeek-V3.1-GGUF

Text Generation • 671B • Updated Aug 24, 2025 • 90 • 15