view post Post 8830 We made a guide on how to run open LLMs in Claude Code, Codex and OpenClaw.Use Gemma 4 and Qwen3.6 GGUFs for local agentic coding on 24GB RAMRun with self-healing tool calls, code execution, web search via the Unsloth API endpoint and llama.cppGuide: https://unsloth.ai/docs/basics/api See translation 🔥 26 26 ❤️ 7 7 + Reply
view post Post 7657 THREE Gemma 4 , 31B Uncensored Fine Tunes (via Unsloth, inhouse datasets):Uncensored first, then tuned.Some benchmarks posted, others pending.Examples posted, detailed instructions.Some GGUFs are up; others pending as of this writing.Enjoy: DavidAU/gemma-4-31B-it-Mystery-Fine-Tune-HERETIC-UNCENSORED-Thinking DavidAU/gemma-4-31B-it-Grand-Horror-X-INTENSE-HERETIC-UNCENSORED-Thinking DavidAU/gemma-4-31B-it-The-DECKARD-HERETIC-UNCENSORED-ThinkingUPDATE: DavidAU/gemma-4-E4B-it-The-DECKARD-Expresso-Universe-HERETIC-UNCENSORED-ThinkingExceeds Gemma4 26B-A4B in critical benchmarks. See translation 6 replies · 🔥 9 9 🚀 1 1 😎 1 1 + Reply
view article Article GGML and llama.cpp join HF to ensure the long-term progress of Local AI +4 ggerganov, ngxson, allozaur, lysandre, victor, julien-c • Feb 20 • 507