Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

23,800

Base only

Active filters: llama-cpp

gate369/drug-alpaca-IQ4_XS-GGUF

8B • Updated Jul 4, 2024 • 6

gate369/drug-alpaca-Q4_K_M-GGUF

8B • Updated Jul 4, 2024 • 8

ClaudioItaly/internlm2_5-7b-Q5_K_M-GGUF

8B • Updated Jul 4, 2024 • 6

notjjustnumbers/gemma-2b-Q4_K_M-GGUF

3B • Updated Jul 7, 2024 • 16

Ransss/gemma2-9B-sunfall-v0.5.2-Q8_0-GGUF

9B • Updated Jul 7, 2024

aifeifei798/gemma2-9B-sunfall-v0.5.2-Q5_K_M-GGUF

9B • Updated Jul 7, 2024 • 3

QGH/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 7, 2024

v000000/Psyonic-Rose-20B-Higher-Quality-Q4_K_M-GGUF

20B • Updated Jul 8, 2024 • 41

mmazeem/Mistral-7B-v0.3-Q4_K_M-GGUF

Updated Jul 7, 2024 • 4

mrgxxer/L3-8B-Stheno-v3.2-Q4_K_M-GGUF

8B • Updated Jul 7, 2024 • 531 • 1

yoeldcd/leniachat-qwen2-1.5B-v0-Q4_K_M-GGUF

2B • Updated Jul 8, 2024 • 20

zachaman/chpr3019-Q8_0-GGUF

Question Answering • 14B • Updated Jul 21, 2024 • 7

zhezhe/gemma-2-9b-it-Q4_K_M-GGUF

Text Generation • 9B • Updated Jul 8, 2024 • 939 • 8

tinyrao/Hermes-2-Pro-Llama-3-8B-Q4_K_M-GGUF

8B • Updated Jul 8, 2024 • 6

saejoon/gemma-2-27b-it-Q4_K_M-GGUF

Text Generation • 27B • Updated Jul 8, 2024 • 23 • 2

Rivaidan/Smegmma-9B-v1-Q8_0-GGUF

9B • Updated Jul 8, 2024 • 5

notjjustnumbers/madlad400-3b-mt-Q4_K_M-GGUF

Translation • 3B • Updated Jul 8, 2024 • 153 • 4

ethangoh/granite-8b-code-instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 8, 2024 • 11

HenryyTwitchyfinger/L3-8B-Stheno-v3.2-Q4_K_M-GGUF

8B • Updated Jul 8, 2024 • 15

utterlygreat/omost-llama-3-8b-IQ4_NL-GGUF

8B • Updated Jul 8, 2024 • 6

teemperor/Phi-3-medium-128k-instruct-Q6_K-GGUF

Text Generation • 14B • Updated Jul 8, 2024 • 5

zhezhe/Gemma-2-9B-Chinese-Chat-Q4_K_M-GGUF

Text Generation • 9B • Updated Jul 8, 2024 • 15

NikolayKozloff/madlad400-3b-mt-Q8_0-GGUF

Translation • 3B • Updated Jul 8, 2024 • 78 • 1

NikolayKozloff/madlad400-10b-mt-Q8_0-GGUF

Translation • 11B • Updated Jul 8, 2024 • 16 • 3

NikolayKozloff/madlad400-10b-mt-Q6_K-GGUF

Translation • 11B • Updated Jul 8, 2024 • 10 • 1

Cran-May/internlm2_5-7b-chat-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 8, 2024 • 4

NikolayKozloff/sqt5-xl-Albanian-shqip-llama.cpp-compatible-Q8_0-GGUF

3B • Updated Jul 8, 2024 • 1

dimcha/mxbai-embed-large-v1-Q4_K_M-GGUF

Feature Extraction • 0.3B • Updated Jul 8, 2024 • 31

bmi-labmedinfo/Igea-3B-v0.1-GGUF

3B • Updated Jul 15, 2024

Cran-May/internlm2_5-7b-chat-IQ4_XS-GGUF

Text Generation • 8B • Updated Jul 8, 2024 • 4