Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

23

Base only

Active filters: inferentia2

aws-neuron/stable-diffusion-xl-base-1-0-1024x1024

Text-to-Image • Updated Nov 7, 2023 • 3

dacorvo/llama-test-upload-folder

Text Generation • Updated Nov 9, 2023 • 1

dacorvo/llama-test-upload-file-by-file

Text Generation • Updated Nov 9, 2023 • 8

aws-neuron/Llama-2-7b-chat-hf-seqlen-2048-bs-4

Text Generation • Updated Nov 9, 2023 • 1

aws-neuron/Llama-2-7b-chat-hf-seqlen-2048-bs-2

Text Generation • Updated Nov 10, 2023 • 6 • 1

aws-neuron/Llama-2-7b-chat-hf-seqlen-2048-bs-1

Text Generation • Updated Nov 11, 2023 • 2

aws-neuron/bge-base-en-v1-5-seqlen-384-bs-1

Feature Extraction • Updated Nov 21, 2023 • 265 • 1

aws-neuron/CodeLlama-7b-hf-neuron-24xlarge

Text Generation • Updated Jan 3, 2024 • 7

aws-neuron/CodeLlama-7b-hf-neuron-8xlarge

Text Generation • Updated Apr 1, 2024 • 6

aws-neuron/Mistral-neuron

Text Generation • Updated Feb 24, 2024 • 12 • 1

aws-neuron/zephyr-7b-beta-neuron

Text Generation • Updated Feb 2, 2024 • 26

jburtoft/SOLAR-10.7B-v1.0-neuron-24xlarge-4096

Text Generation • Updated Jan 13, 2024 • 3

aws-neuron/SOLAR-10.7B-v1.0-neuron

Text Generation • Updated Sep 5, 2024 • 3

aws-neuron/Mistral-7B-Instruct-v0.1-neuron-4x2048-24-cores

Text Generation • Updated Jan 23, 2024 • 3

aws-neuron/Mistral-7B-Instruct-v0.1-neuron-1x2048-24-cores

Text Generation • Updated Jan 23, 2024 • 1

aws-neuron/Mistral-7B-Instruct-v0.1-neuron-1x2048-2-cores

Text Generation • Updated Jan 23, 2024 • 7 • 2

aws-neuron/Mistral-7B-Instruct-v0.2-seqlen-2048-bs-1-cores-2

Text Generation • Updated Feb 24, 2024 • 2

davidshtian/Mistral-7B-Instruct-v0.2-neuron-1x2048-2-cores

Text Generation • Updated Feb 26, 2024 • 6 • 1

davidshtian/Mistral-7B-Instruct-v0.2-neuron-1x2048-2-cores-2.18

Text Generation • Updated Apr 2, 2024 • 7 • 1

davidshtian/Mistral-7B-Instruct-v0.2-neuron-1x2048-24-cores-2.18

Text Generation • Updated Apr 2, 2024 • 5

davidshtian/Mistral-7B-Instruct-v0.2-neuron-4x2048-24-cores-2.18

Text Generation • Updated Apr 2, 2024 • 3

fjcloud/Mistral-7B-Instruct-v0.3-neuron-inf2-tp2

Text Generation • 1 • Updated Feb 12 • 3

fjcloud/Qwen3-8B-neuron-inf2-tp2

Updated Feb 13 • 13