Inference Providers
Active filters: nm-vllm
RedHatAI/TinyLlama-1.1B-Chat-v1.0-pruned2.4
Text Generation
• Updated • 2.13k
• • 1
RedHatAI/MiniChat-2-3B-pruned2.4
Text Generation
• Updated • 24
RedHatAI/OpenHermes-2.5-Mistral-7B-pruned2.4
Text Generation
• Updated • 17
RedHatAI/OpenHermes-2.5-Mistral-7B-pruned50
Text Generation
• Updated • 21
• 1
RedHatAI/Nous-Hermes-2-SOLAR-10.7B-pruned2.4
Text Generation
• Updated • 16
RedHatAI/Nous-Hermes-2-Yi-34B-pruned2.4
Text Generation
• Updated • 22
RedHatAI/Nous-Hermes-2-Yi-34B-pruned50
Text Generation
• Updated • 21
RedHatAI/zephyr-7b-beta-marlin
Text Generation
• 1B • Updated • 35
RedHatAI/llama2.c-stories110M-pruned2.4
Text Generation
• Updated • 23
RedHatAI/llama2.c-stories110M-pruned50
Text Generation
• Updated • 1.91k
Text Generation
• 3B • Updated • 24
RedHatAI/TinyLlama-1.1B-Chat-v1.0-marlin
Text Generation
• 0.3B • Updated • 1.11k
• 2
RedHatAI/OpenHermes-2.5-Mistral-7B-marlin
Text Generation
• 1B • Updated • 20
• 2
RedHatAI/Nous-Hermes-2-Yi-34B-marlin
Text Generation
• 5B • Updated • 22
• 5
softmax/Llama-2-70b-chat-hf-marlin
Text Generation
• 10B • Updated • 5
softmax/falcon-180B-chat-marlin
Text Generation
• 26B • Updated • 5
dtransposed/llama2.c-stories110M-pruned50-compressed-tensors
Text Generation
• Updated • 2
mradermacher/Nous-Hermes-2-SOLAR-10.7B-pruned2.4-GGUF
11B • Updated • 127
mradermacher/Nous-Hermes-2-SOLAR-10.7B-pruned2.4-i1-GGUF
11B • Updated • 403
tensorblock/llama2.c-stories110M-pruned50-GGUF
0.1B • Updated • 28
mradermacher/phi-2-pruned50-GGUF
3B • Updated • 59
mradermacher/llama2.c-stories110M-pruned50-GGUF
0.1B • Updated • 48
mradermacher/OpenHermes-2.5-Mistral-7B-pruned50-GGUF
7B • Updated • 70
• 1
mradermacher/MiniChat-2-3B-pruned2.4-GGUF
3B • Updated • 82
mradermacher/OpenHermes-2.5-Mistral-7B-pruned50-i1-GGUF
7B • Updated • 125
mradermacher/llama2.c-stories110M-pruned50-i1-GGUF
0.1B • Updated • 39
mradermacher/OpenHermes-2.5-Mistral-7B-pruned2.4-GGUF
7B • Updated • 31
mradermacher/OpenHermes-2.5-Mistral-7B-pruned2.4-i1-GGUF
7B • Updated • 94
tensorblock/OpenHermes-2.5-Mistral-7B-pruned2.4-GGUF
tensorblock/OpenHermes-2.5-Mistral-7B-pruned50-GGUF