Love this model 🥰
#15
by auf1r2 - opened
Hey guys!
Thank you for releasing this beutiful model to our community! I think this model deserves more stars than it currently have. It's better than Qwen3.5-122b and on par or better than Laguna S-2.1.
My question is: what is the maxumum context size for it? 131k or 262k?
Model card says Context Training Schedule 8K -> 32K -> 256K Does this means 256k?
Because quantized version from https://huggingface.co/bloomer010/Ling-3.0-flash-GGUF/ when runned in llama.cpp caps context size to 131k
W llama_context: n_ctx_seq (262144) > n_ctx_train (131072) -- possible training context overflow
W srv load_model: the slot context (262144) exceeds the training context of the model (131072) - capping
I srv load_model: initializing, n_slots = 4, n_ctx_slot = 131072, kv_unified = 'true'
Is this quantized version bug? Or the original MAX context size of the model 131k?