Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

45

Base only

Active filters: private

Thox-ai/ThoxIntel-27B-GGUF

Image-Text-to-Text • 27B • Updated 1 day ago • 2 • 1

lopushanskyy/music-generation

Audio Classification • Updated May 30, 2022 • 7 • 4

AmpleAI/AmpleChat-3B-GGUF

3B • Updated Jan 12, 2025 • 2 • 1

suiyaradant/whisper-large-v3

Automatic Speech Recognition • 0.8B • Updated May 18, 2025

Huseyin/qwen3-8b-turkish-teknofest2025-private

Updated Aug 19, 2025

shayzinasimulation/Red-Angel-Senate

Any-to-Any • Updated Dec 3, 2025 • 4

efops/marziel-8b-custom

Text Generation • 8B • Updated Mar 29 • 21

kai-os/Carnice-27b

Text Generation • 27B • Updated Apr 8 • 28 • 36

kai-os/Carnice-27b-GGUF

Text Generation • 27B • Updated Apr 6 • 41 • 32

ponytang3/Carnice-27b-heretic

Text Generation • 27B • Updated Apr 10 • 12

mradermacher/Carnice-27b-heretic-GGUF

27B • Updated Apr 11 • 202

mradermacher/Carnice-27b-heretic-i1-GGUF

27B • Updated Apr 11 • 253 • 1

k0valik-21/Carnice-27b-Q3_K_S-GGUF

Text Generation • 27B • Updated Apr 19 • 10 • 1

Outlier-Ai/DeepSeek-R1-Distill-Qwen-32B-MLX-4bit

Text Generation • 33B • Updated May 5 • 392

Outlier-Ai/DeepSeek-R1-Distill-Qwen-14B-MLX-4bit

Text Generation • 15B • Updated May 5 • 497

Outlier-Ai/DeepSeek-R1-Distill-Llama-8B-MLX-4bit

Text Generation • 1B • Updated May 5 • 147

Outlier-Ai/DeepSeek-R1-Distill-Qwen-7B-MLX-4bit

Text Generation • 1B • Updated May 5 • 148

Outlier-Ai/QwQ-32B-MLX-4bit

Text Generation • 33B • Updated May 26 • 28

Outlier-Ai/Qwen3-Coder-30B-A3B-Instruct-MLX-4bit

Text Generation • 31B • Updated May 5 • 361

Outlier-Ai/Qwen2.5-Coder-32B-Instruct-MLX-4bit

Text Generation • 33B • Updated May 5 • 275

Outlier-Ai/Qwen2.5-Coder-14B-Instruct-MLX-4bit

Text Generation • 15B • Updated May 5 • 169

Outlier-Ai/Qwen2.5-Coder-7B-Instruct-MLX-4bit

Text Generation • 1B • Updated May 5 • 184

Outlier-Ai/Yi-Coder-9B-Chat-MLX-4bit

Text Generation • 1B • Updated May 26 • 155

Outlier-Ai/Phi-4-mini-instruct-MLX-4bit

Text Generation • 0.6B • Updated May 26 • 106

Outlier-Ai/Qwen3-32B-MLX-4bit

Text Generation • 33B • Updated May 26 • 18

Outlier-Ai/Qwen3-14B-MLX-4bit

Text Generation • 15B • Updated May 26 • 132 • 1

Outlier-Ai/Qwen3-8B-MLX-4bit

Text Generation • 1B • Updated May 26 • 25

Outlier-Ai/Qwen3-4B-MLX-4bit

Text Generation • 0.6B • Updated May 26 • 8

Outlier-Ai/gpt-oss-20b-MLX-4bit

Text Generation • 21B • Updated May 5 • 32

Outlier-Ai/SmolLM3-3B-MLX-4bit

Text Generation • 0.5B • Updated May 26 • 18