Instructions to use Alphacode-AI/Alphacode-MALI-9B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Alphacode-AI/Alphacode-MALI-9B with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Alphacode-AI/Alphacode-MALI-9B")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForMultimodalLM

tokenizer = AutoTokenizer.from_pretrained("Alphacode-AI/Alphacode-MALI-9B")
model = AutoModelForMultimodalLM.from_pretrained("Alphacode-AI/Alphacode-MALI-9B")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Alphacode-AI/Alphacode-MALI-9B with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Alphacode-AI/Alphacode-MALI-9B"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Alphacode-AI/Alphacode-MALI-9B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/Alphacode-AI/Alphacode-MALI-9B

SGLang

How to use Alphacode-AI/Alphacode-MALI-9B with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Alphacode-AI/Alphacode-MALI-9B" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Alphacode-AI/Alphacode-MALI-9B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Alphacode-AI/Alphacode-MALI-9B" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Alphacode-AI/Alphacode-MALI-9B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use Alphacode-AI/Alphacode-MALI-9B with Docker Model Runner:
```
docker model run hf.co/Alphacode-AI/Alphacode-MALI-9B
```

Alphacode-MALI-9B

Commit History

Update README.md

1745ecd
verified

Alphacode-AI-Team commited on May 28, 2024

fix weight

e171bcc

Lee Seokchan commited on May 16, 2024

Fix Weight 7B

6193baf

Lee Seokchan commited on May 14, 2024

Fix weight

23f8d5d

Lee Seokchan commited on May 14, 2024

Fix Weight

749e82e

Lee Seokchan commited on May 14, 2024

Fix Model size

fa76c12

Lee Seokchan commited on May 14, 2024

Update config.json

2e00413
verified

Alphacode-AI-Team commited on May 14, 2024

Upload logo.png

8c9e5e0
verified

Alphacode-AI-Team commited on May 14, 2024

Delete logo.png

2467bd1
verified

Alphacode-AI-Team commited on May 14, 2024

Update README.md

cde5292
verified

Alphacode-AI-Team commited on May 14, 2024

Upload logo.png

2e52ae3
verified

Alphacode-AI-Team commited on May 14, 2024

Update README.md

803ada2
verified

Alphacode-AI-Team commited on May 14, 2024

Upload Alphacode_MALI.jpeg

9648eae
verified

Alphacode-AI-Team commited on May 14, 2024

Update README.md

e1ec68d
verified

Alphacode-AI-Team commited on May 14, 2024

Add Model

9542bf5

Lee Seokchan commited on May 14, 2024

initial commit

00169c3
verified

Alphacode-AI-Team commited on May 14, 2024

Commit History

Update README.md 1745ecd verified

fix weight e171bcc

Fix Weight 7B 6193baf

Fix weight 23f8d5d

Fix Weight 749e82e

Fix Model size fa76c12

Update config.json 2e00413 verified

Upload logo.png 8c9e5e0 verified

Delete logo.png 2467bd1 verified

Update README.md cde5292 verified

Upload logo.png 2e52ae3 verified

Update README.md 803ada2 verified

Upload Alphacode_MALI.jpeg 9648eae verified

Update README.md e1ec68d verified

Add Model 9542bf5

initial commit 00169c3 verified

Update README.md

1745ecd
verified

fix weight

e171bcc

Fix Weight 7B

6193baf

Fix weight

23f8d5d

Fix Weight

749e82e

Fix Model size

fa76c12

Update config.json

2e00413
verified

Upload logo.png

8c9e5e0
verified

Delete logo.png

2467bd1
verified

Update README.md

cde5292
verified

Upload logo.png

2e52ae3
verified

Update README.md

803ada2
verified

Upload Alphacode_MALI.jpeg

9648eae
verified

Update README.md

e1ec68d
verified

Add Model

9542bf5

initial commit

00169c3
verified