Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

974

Base only

Active filters: 4bit

mradermacher/SEOcrate-4B_grpo_new_01-i1-GGUF

Reinforcement Learning • 4B • Updated Jul 11, 2025 • 282

vannishh/llama3-2.1B-4bit-finetuned

Updated May 15, 2025 • 1

Programmer-RD-AI/ResearchQwen-2.5-3B-LoRA

Question Answering • 3B • Updated May 26, 2025 • 9 • 4

CodCodingCode/DeepSeek-V2-medical

Text Generation • Updated May 18, 2025

tripolskypetr/Plutus-Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • 8B • Updated May 21, 2025 • 124 • 1

abdou-u/MNLP_M2_quantized_model

Text Generation • 0.6B • Updated May 19, 2025 • 6

HagalazAI/CyberDolphin-2.9.3-mistral-nemo-12b

Text Generation • 12B • Updated May 22, 2025 • 6 • 1

HagalazAI/CyberDolphin-2.9.3-mistral-nemo-12b-GGUF

Text Generation • 12B • Updated May 23, 2025 • 219 • 2

Jimmi42/sarvam-m-4bit-mlx

Text Generation • 4B • Updated May 26, 2025 • 92 • 2

geninhu/RakutenAI-7B-instruct-GPTQ

Updated May 30, 2025 • 3

umangshikarvar/sentiment-qlora-gptneo

Text Classification • Updated Jun 2, 2025 • 1

Fulstac/deepseek-r1-Distill-Qwen-32B-sqlgen-4bit-v1

Text Generation • 33B • Updated Jun 6, 2025 • 6

Fulstac/deepseek-r1-Distill-Qwen-32B-lora-4bit-v3

Text Generation • 33B • Updated Jun 6, 2025 • 5

acauanrr/qlora-ti-2025-adapter

Updated Jun 7, 2025 • 4

abdou-u/MNLP_M3_quantized_dpo_mcqa_model

Multiple Choice • 0.6B • Updated Jun 8, 2025 • 1

kevin510/friday-4bit

Text Generation • 4B • Updated Sep 23, 2025 • 6

ayureasehealthcare/ayurezeastraai

Text Generation • Updated Jun 13, 2025

Renugadevi82/cisco-nx-ai-4bit

1B • Updated Jun 16, 2025 • 1

avinashhm/Llama-3.1-Nemotron-Nano-4B-v1.1-GPTQ

Text Generation • 5B • Updated Jun 17, 2025 • 2

btbtyler09/Kimi-Dev-72B-GPTQ-4bit

Text Generation • 73B • Updated Jun 19, 2025 • 17 • 2

riddhimanrana/fastvlm-0.5b-captions

Image-Text-to-Text • 99.1M • Updated Aug 31, 2025 • 153 • 3

mehta/CooperLM-354M-4bit

Text Generation • 0.4B • Updated Jun 21, 2025 • 3 • 1

adriabama06/GLM-4-9B-0414-exl3

Text Generation • Updated Jun 23, 2025 • 8 • 1

JustJaro/SmolLM-135M_gptq_g32_4bit

Text Generation • 0.1B • Updated Jul 7, 2025 • 1

ConfidentialMind/Mistral-Small-3.2-24B-Instruct-2506-GPTQ-AutoRound-TextOnly

Text Generation • 24B • Updated Jul 7, 2025 • 803

btbtyler09/Qwen3-30B-A3B-gptq-4bit

Text Generation • 31B • Updated Jul 30, 2025 • 5

Chun121/Qwen3-4B-RPG-Roleplay-V2

Text Generation • 4B • Updated Aug 24, 2025 • 16.8k • 62

dsuram/mistral-medical-finetuned

Text Generation • Updated Jul 7, 2025

nxtcloud-org/kanana-safeguard-8b-bitsandbytes-4bit

Text Generation • 8B • Updated Jul 22, 2025 • 42 • 1

nxtcloud-org/kanana-safeguard-prompt-2.1b-bitsandbytes-4bit

2B • Updated Jul 22, 2025 • 36 • 1