Johannes

jrudolph

1

·

jrudolph

AI & ML interests

None yet

Organizations

None yet

New activity in TheBloke/Llama-2-7B-GGUF almost 3 years ago

GGUF q4_0 model variants quantize the "output.weight" tensor with q6_k (compared to former ggml files which left them at fp32 iirc)

#4 opened almost 3 years ago by