Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

23,652

Base only

Active filters: llama-cpp

bingbort/SOLAR-19.2B-Instruct-v1.0-Q4_K_M-GGUF

19B • Updated Apr 15, 2024 • 9

bingbort/bigstral-12b-v0.2-32k-Q6_K-GGUF

12B • Updated Apr 15, 2024 • 7

andreass123/EEVE-Korean-2.8B-v1.0-Q8_0-GGUF

3B • Updated Apr 15, 2024 • 2

andreass123/EEVE-Korean-Instruct-2.8B-v1.0-Q4_K_M-GGUF

3B • Updated Apr 15, 2024 • 28

andreass123/EEVE-Korean-Instruct-2.8B-v1.0-Q8_0-GGUF

3B • Updated Apr 15, 2024 • 7

gate369/Bitnet-M7-70m-Q8_0-GGUF

77.5M • Updated Apr 15, 2024 • 65 • 2

gate369/bitmap-mistral-alpaca-70m-Q8_0-GGUF

77.5M • Updated Apr 15, 2024 • 6

bingbort/Einstein_x_Dolphin-Q8_0-GGUF

7B • Updated Apr 15, 2024 • 8

bingbort/mergekit-slerp-vehkdva-Q8_0-GGUF

7B • Updated Apr 15, 2024 • 3

Desumor/WizardLM-2-7B-GGUF

7B • Updated Apr 15, 2024 • 2 • 3

Aryanne/WizardLM-2-7B-Q4_K_M-GGUF

7B • Updated Apr 15, 2024 • 6 • 3

RaincloudAi/WizardLM-2-7B-Q4_K_M-GGUF

7B • Updated Apr 16, 2024 • 6

rabimba/Gemma-COT-Q4_K_M-GGUF

9B • Updated Apr 17, 2024 • 14

umarigan/TURKCELL-LLM-7B-DPO-Q4_K_M-GGUF

7B • Updated Apr 16, 2024 • 8 • 1

NikolayKozloff/tweety-7b-italian-GGUF

Text Generation • 7B • Updated Apr 16, 2024 • 6 • 1

cybercheems2077/mistral-maths7B-Q4_K_M-GGUF

7B • Updated Apr 16, 2024 • 9

NikolayKozloff/CodeQwen1.5-7B-Q8_0-GGUF

Text Generation • 7B • Updated Apr 16, 2024 • 8 • 4

SilverFan/WizardIceLemonTeaRP-7b-32k-GGUF

7B • Updated Apr 19, 2024 • 3

MythicalCow/llama2-7b-openhermes-15k-mini-Q4_K_M-GGUF

7B • Updated Apr 17, 2024 • 7

zypcastles/Qwen1.5-48B-Chat-Q6_K-GGUF

48B • Updated Apr 17, 2024 • 6

NikolayKozloff/DolphinLake-7B-Q8_0-GGUF

7B • Updated Apr 17, 2024 • 4 • 1

NikolayKozloff/Llama-portuguese-13b-Luana-v0.2-GGUF

Text Generation • 13B • Updated Apr 17, 2024 • 14 • 1

NikolayKozloff/Qwen-portuguese-luana-7b-GGUF

Text Generation • 8B • Updated Apr 17, 2024 • 64 • 1

NikolayKozloff/gemma-portuguese-luana-2b-GGUF

Text Generation • 3B • Updated Apr 17, 2024 • 11 • 2

MrAiran/pythia-13b-deduped-green_devil-Q4_K_M-GGUF

12B • Updated Apr 18, 2024 • 19

MrAiran/pythia-13b-deduped-green_devil-Q4_K_S-GGUF

12B • Updated Apr 18, 2024 • 14

Trisert/OrcaPlus-Q4_K_S-GGUF

14B • Updated Apr 18, 2024 • 9

Clevyby/Red-Daffodil-7B-Q5_K_S-GGUF

Text Generation • 7B • Updated May 2, 2024 • 11

Clevyby/SnowyRP-V2-13B-L2_BetaTest-Q4_K_M-GGUF

Text Generation • 13B • Updated May 2, 2024 • 19

nzwildcode/FlasherAI-v0.1-7B-Q4_K_M-GGUF

7B • Updated Apr 18, 2024 • 9