Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

974

Base only

Active filters: 4bit

praiselab-picuslab/Llama-3.2-1B-Instruct-Cardiologia

Question Answering • 1B • Updated May 11 • 4

praiselab-picuslab/Llama-3.2-1B-Instruct-Dermatologia

Question Answering • 1B • Updated May 11 • 5

praiselab-picuslab/Llama-3.2-1B-Instruct-Gastroenterologia

Question Answering • 1B • Updated May 11 • 10

praiselab-picuslab/Llama-3.2-1B-Instruct-Ginecologia

Question Answering • 1B • Updated May 11 • 3

praiselab-picuslab/Llama-3.2-1B-Instruct-Medicina-Generale

Question Answering • 1B • Updated May 11 • 191

praiselab-picuslab/Llama-3.2-1B-Instruct-Neurologia

Question Answering • 1B • Updated May 11 • 2

praiselab-picuslab/Llama-3.2-1B-Instruct-Oculistica

Question Answering • 1B • Updated May 11 • 3

praiselab-picuslab/Llama-3.2-1B-Instruct-Ortopedia

Question Answering • 1B • Updated May 11 • 3

praiselab-picuslab/Llama-3.2-1B-Instruct-Salute-Mentale

Question Answering • 1B • Updated May 11 • 5

praiselab-picuslab/Llama-3.2-1B-Instruct-Urologia

Question Answering • 1B • Updated May 11 • 2

Oscilla/intellite-500m-sft-4bit-mlx

Text Generation • 78.3M • Updated May 11 • 12 • 1

MLXBits/sulphur-2-distill-mlx-q4

Image-Text-to-Video • Updated May 12 • 405 • 23

itselouardi/ZAYA1-8B-bnb-4bit

Text Generation • 9B • Updated May 12 • 34 • 3

suhas9545/Qwen2.5-3B-SWE-Agent-QLoRA

Text Generation • Updated May 14

WaveCut/Anima-Preview-3-SDNQ-uint4

Text-to-Image • 1B • Updated May 13 • 28 • 1

gratex/Qwen3.6-27B-W4A16-g32-asym

Image-Text-to-Text • 29B • Updated May 13 • 168

gratex/Kimi-K2.6-REAM-25

Image-Text-to-Text • 130B • Updated May 15 • 29

asepnorzai/FoodExtract-gemma-3-270m-fine-tune-v1-4bit

0.3B • Updated May 16 • 2

mhalimi3008/mujib-llm-lora

Text Generation • Updated May 16

chanderbalaji/Intern-S2-Preview-FP8-MLX-4bit

Text Generation • 35B • Updated May 17 • 93 • 1

woa9875/CyberDolphin-2.9.3-mistral-nemo-12b

Text Generation • 12B • Updated May 17 • 5

AMAImedia/CodeRM-GRPO-Selection-8B-NOESIS-AWQ-INT4

Text Classification • 8B • Updated May 17 • 4 • 1

MitzMitz/Llama-ChemLink-Parser-8B-MTYS

Updated 13 days ago

3amthoughts/mistral-7b-instruct-v0.3-bnb-4bit

Text Generation • 7B • Updated May 19 • 7

Reza2kn/mega-asr-mlx

Automatic Speech Recognition • Updated May 22

Reza2kn/mega-asr-coreml

Automatic Speech Recognition • Updated May 22

Noobneophyte/supergemma4-26b-uncensored-mlx-4bit-v2

Text Generation • 25B • Updated May 22 • 137

Reza2kn/mega-asr-nvfp4

Automatic Speech Recognition • Updated May 22

v102ss/Alice-Qwen3.5-4B-Heretic-Light-MLX-4bit

Text Generation • 0.7B • Updated May 23 • 30

karwalski/toke

Text Generation • 8B • Updated May 24 • 13 • 1