EXL3 models
Collection
64 items • Updated • 61
How to use turboderp/HyperCLOVAX-SEED-Think-14B-exl3 with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("turboderp/HyperCLOVAX-SEED-Think-14B-exl3", device_map="auto")EXL3 quants of HyperCLOVAX-SEED-Think-14B
⚠️ Requires ExLlamaV3 v0.0.19 (or v0.0.18 dev branch)
Base bitrates:
Base model
naver-hyperclovax/HyperCLOVAX-SEED-Think-14B