Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

28

Base only

Active filters: magicquant

magiccodingman/Granite-4.0-H-350M-Unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 0.3B • Updated Apr 25 • 80 • 1

magiccodingman/Qwen3-4B-Instruct-2507-Unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 4B • Updated Apr 25 • 388 • 8

magiccodingman/Qwen3-4B-Thinking-2507-Unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 4B • Updated Apr 25 • 173 • 2

magiccodingman/Qwen3-30B-A3B-Thinking-2507-unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 31B • Updated Apr 25 • 350 • 5

magiccodingman/Qwen3-30B-A3B-Instruct-2507-unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 31B • Updated Apr 25 • 212 • 4

magiccodingman/Seed-OSS-36B-Instruct-unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 36B • Updated Apr 25 • 835 • 10

magiccodingman/Apriel-1.5-15b-Thinker-unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 14B • Updated Apr 25 • 134 • 2

magiccodingman/Qwen3-4B-Instruct-2507-Unsloth-MagicQuant-v2-GGUF

Text Generation • 4B • Updated May 26 • 211 • 1

magiccodingman/Qwen3.6-35B-A3B-MagicQuant-GGUF

Text Generation • 35B • Updated May 26 • 564 • 6

magiccodingman/Qwen3.6-35B-A3B-Uncensored-MagicQuant-GGUF

Text Generation • 35B • Updated May 26 • 930 • 5

magiccodingman/Qwen3.6-27B-MagicQuant-MTP-GGUF

Text Generation • 27B • Updated May 26 • 855 • 4

magiccodingman/Qwen3.6-27B-Uncensored-MagicQuant-MTP-GGUF

Text Generation • 27B • Updated May 26 • 862 • 4

lmcoleman/ThinkingCap-Qwen3.6-27B-MagicQuant-GGUF

Text Generation • 27B • Updated 30 days ago • 617 • 6

lmcoleman/ThinkingCap-Qwen3.6-27B-ROCmFPX-GGUF

Text Generation • 27B • Updated Aug 3 • 148 • 7

lmcoleman/Qwen3.6-27B-Fable-Fusion-711-MTP-MagicQuant-GGUF

Text Generation • 0.5B • Updated 30 days ago • 2.31k • 1

lmcoleman/Qwen3.6-27B-Fable-Fusion-711-MTP-ROCmFPX-GGUF

Text Generation • 0.5B • Updated Aug 7 • 331 • 5

lmcoleman/Qwen3.6-35B-A3B-MagicQuant-GGUF

Text Generation • 36B • Updated 30 days ago • 377

lmcoleman/Qwen3.6-35B-A3B-ROCmFPX-GGUF

Text Generation • 36B • Updated Aug 1 • 32

lmcoleman/Qwen3.6-35B-A3B-BUDGET-GGUF

Text Generation • 36B • Updated 30 days ago • 417 • 1

spotapovadm/Qwen3.6-35B-A3B-ROCmFPX-GGUF

Text Generation • 36B • Updated Aug 11 • 43 • 1

lmcoleman/Muse-Glimmer-30B-MagicQuant-GGUF

Text Generation • 28B • Updated 30 days ago • 414

lmcoleman/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-MagicQuant-GGUF

33B • Updated 30 days ago • 437

lmcoleman/Qwen3.8-27B-MagicQuant-GGUF

Text Generation • 27B • Updated 30 days ago • 889 • 3

lmcoleman/Qwen3.8-27B-ROCmFPX-GGUF

Text Generation • 27B • Updated Aug 16 • 1.78k • 7

magiccodingman/Qwen3.8-27B-MagicQuant-GGUF

Text Generation • 27B • Updated 29 days ago • 5.5k • 12

lmcoleman/Ornith-1.5-35B-A3B-MagicQuant-GGUF

Image-Text-to-Text • 36B • Updated 6 days ago • 1.18k

lmcoleman/Ornith-1.5-35B-A3B-ROCmFPX-GGUF

Image-Text-to-Text • 36B • Updated 28 days ago • 350

magiccodingman/Qwen3.8-27B-MXFP4-MagicQuant-GGUF

Image-Text-to-Text • 27B • Updated 24 days ago • 8.45k • 5