Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

23,693

Base only

Active filters: llama-cpp

NikolayKozloff/L3.1-8B-Celeste-V1.5-Q8_0-GGUF

8B • Updated Jul 28, 2024 • 2 • 1

Ransss/L3-TheGreenLion-8b-SFT-v0.1.2-Q8_0-GGUF

8B • Updated Jul 28, 2024 • 2

tklohj/WindyLLM_kor_3.1-Q8_0-GGUF

8B • Updated Jul 28, 2024 • 2

tklohj/WindyLLM_kor_jpn_eng-Q8_0-GGUF

8B • Updated Jul 28, 2024 • 7

aaronday3/Celeste-12B-V1.6-Q4_K_M-GGUF

12B • Updated Jul 28, 2024 • 11

aaronday3/Celeste-12B-V1.6-Q6_K-GGUF

12B • Updated Jul 28, 2024 • 2

sosoai/hansoldeco-llama-3.1-8b-it-FFT-v0.1-Q4_K_M-GGUF

8B • Updated Jul 29, 2024 • 4

sosoai/hansoldeco-llama-3.1-8b-it-FFT-v0.1-Q8_0-GGUF

8B • Updated Jul 29, 2024 • 1

sosoai/hansoldeco-llama-3.1-8b-it-FFT-v0.1-Q6_K-GGUF

8B • Updated Jul 29, 2024 • 14

aifeifei799/Phi-3-mini-128k-instruct-abliterated-v3-Q5_K_M-GGUF

Text Generation • 4B • Updated Jul 29, 2024 • 23

aifeifei799/Phi-3-mini-128k-instruct-abliterated-v3-Q8_0-GGUF

Text Generation • 4B • Updated Jul 29, 2024 • 41

sosoai/hansoldeco-llama-3.1-8b-it-v0.2-Q4_K_M-GGUF

8B • Updated Jul 29, 2024 • 9

sosoai/hansoldeco-llama-3.1-8b-it-v0.2-Q8_0-GGUF

8B • Updated Jul 29, 2024 • 4

tohur/natsumura-assistant-1.0-llama-3.1-8b-GGUF

Updated Jul 29, 2024 • 57

faerdhinen/Fimbulvetr-11B-v2-Q4_K_M-GGUF

11B • Updated Jul 29, 2024 • 35

e2jhiubyiiyvw/Meta-Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Jul 29, 2024 • 11

Cran-May/openbuddy-llama3.1-8b-v22.2-131k-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 29, 2024 • 2 • 1

newsletter/magnum-32b-v1-Q6_K-GGUF

Text Generation • 33B • Updated Jul 29, 2024 • 12

nitinrathi/TinyLlama_v1.1_math_code-Q8_0-GGUF

1B • Updated Jul 29, 2024 • 3

nitinrathi/TinyLlama_v1.1-Q8_0-GGUF

1B • Updated Jul 29, 2024 • 6

yishan-wang/snowflake-arctic-embed-s-Q8_0-GGUF

Sentence Similarity • 33.2M • Updated Jul 29, 2024 • 13

chrypnotoad/Meta-Llama-3.1-8B-Q8_0-GGUF

Text Generation • 8B • Updated Jul 29, 2024 • 12

shoemaker/gemma2-9B-daybreak-v0.5-Q8_0-GGUF

9B • Updated Jul 29, 2024 • 4

brtaydin/gte-Qwen2-7B-instruct-Q5_K_M-GGUF

Sentence Similarity • 8B • Updated Jul 29, 2024 • 8

uknownengineer11/Llama-3-SauerkrautLM-8b-Instruct-Q4_K_M-GGUF

8B • Updated Jul 29, 2024 • 4

apoorvparmar007/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 29, 2024 • 17

Stark2008/Llama-3-8B-Instruct_dare_ties-density-0.7-Q6_K-GGUF

8B • Updated Jul 29, 2024 • 9

Stark2008/Llama-3-8B-Instruct_dare_ties-density-0.3-Q6_K-GGUF

8B • Updated Jul 29, 2024 • 2

Stark2008/romulus-mistral-nemo-12b-simpo-Q4_K_M-GGUF

12B • Updated Jul 29, 2024 • 84 • 1

reach-vb/Meta-Llama-3.1-8B-Instruct-Q6_K-GGUF

Text Generation • 8B • Updated Jul 30, 2024 • 144 • 8