Love this model 🥰

#15
by auf1r2 - opened

Hey guys!

Thank you for releasing this beutiful model to our community! I think this model deserves more stars than it currently have. It's better than Qwen3.5-122b and on par or better than Laguna S-2.1.

My question is: what is the maxumum context size for it? 131k or 262k?

Model card says Context Training Schedule 8K -> 32K -> 256K Does this means 256k?

Because quantized version from https://huggingface.co/bloomer010/Ling-3.0-flash-GGUF/ when runned in llama.cpp caps context size to 131k

W llama_context: n_ctx_seq (262144) > n_ctx_train (131072) -- possible training context overflow
W srv    load_model: the slot context (262144) exceeds the training context of the model (131072) - capping
I srv    load_model: initializing, n_slots = 4, n_ctx_slot = 131072, kv_unified = 'true'

Is this quantized version bug? Or the original MAX context size of the model 131k?

Sign up or log in to comment