mradermacher

/

model_requests

like 180

so many mythoses and fables

anyways, check your tensors, make sure that model is the same shape as the base (tested june 20): llama_model_load: error loading model: missing tensor 'blk.32.attn_norm.weight'

llama_model_load: error loading model: missing tensor 'blk.32.attn_norm.weight'

Do you have any idea why @empero-ai ?

@redaihf

This bug was related to the MTP heads and was fixed in our v2 GGUFs here: https://huggingface.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M-GGUF

Due to our own customized training loop there have been some issues with the initial release.

@RichardErkhov

For looping issues its imperative to follow the recommended sampling parameters as we mention in the model card:
https://huggingface.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M#sampling-recommendations

The model is being used by a lot of people in production and works very well.