Which version of VLLM should I use to run this checkpoint?

#2
by gameofdimension - opened

Probably nightly image, the 0.23.0 release is missing a few pull requests for GLM-5.2

Until they release 0.24.0

the 0.23.0 release is missing a few pull requests for GLM-5.2
@g-a-b-y , what is missing? I am running it on v0.23.0. (B300s)

the 0.23.0 release is missing a few pull requests for GLM-5.2
@g-a-b-y , what is missing? I am running it on v0.23.0. (B300s)

All the fixes here are not in 0.23.0,

https://github.com/vllm-project/vllm/issues/46654

Sign up or log in to comment