yahavb
/

nxd_vllm_8b

Model card Files Files and versions

16.1 GB

Ctrl+K

Ctrl+K

1 contributor

History: 3 commits

yahavb's picture

Add NxD compiled model yahavb/nxd_vllm_8b for vLLM

17b1eb2 verified about 1 year ago

weights
Add NxD compiled model yahavb/nxd_vllm_8b for vLLM about 1 year ago
.gitattributes

1.52 kB
initial commit about 1 year ago
model.pt
Detected Pickle imports (9)
- "__torch__.neuronx_distributed.trace.spmd.NxDModelExecutor",
- "__torch__.torch.classes.neuron.LayoutTransformation",
- "__torch__.neuronx_distributed.trace.spmd.NxDModel",
- "torch.jit._pickle.restore_type_tag",
- "torch.FloatStorage",
- "torch.IntStorage",
- "collections.OrderedDict",
- "torch.jit._pickle.restore_type_tag",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
13 MB
xet

Add NxD compiled model yahavb/nxd_vllm_8b for vLLM about 1 year ago
neuron_config.json

5.27 kB
Add NxD compiled model yahavb/nxd_vllm_8b for vLLM about 1 year ago