GGUF

Read the Portuguese translation →

Mentioned in

• MiniCPM-V 4.7 1B: Install with Ollama and llama.cpp, Then Push It to the Limit
• Tencent’s Memory Model “Beats Claude Opus 5”. I Rented a GPU to Check
• Qwen 3.8 27B é o MELHOR modelo para rodar LOCAL que existe (resultados ABSURDOS)
• 12B Coding Model on an 8GB Laptop GPU? I Tested It
• Xiaomi Just Open-Sourced Its RL Training Secrets — I Used Them to Train My Own AI
• Bilibili’s New Translation Model Runs on My 8GB Laptop - I Tested the Memes
• DeepSeek-V4.1-Flash-1017 GSQ+RCO GGUF: Run Under 12GB VRAM Locally
• This Tiny Coding Model Shouldn’t Be This Good (MiniCPM5)
• Ternary Bonsai 2 9B in GGUF: A 2.4 GB Model Locally
• Spark-X2.6-4B’s CRAZY Thinking Dial: 180 Tests on an 8GB GPU
• JEV+RUST vs Python+Deepseek: Detectando fraudes no Pix em tempo real!
• Qwen-Image-2.1-Turbo on an 8GB Laptop: 10 Images, 768 to 2048, Real Timings
• Strata vs Llama.cpp vs vLLM
• Germany’s New 78B Open Model (Kolibri-1) Runs at 126 Tokens/Sec on ONE GPU (I Tested It Hard)
• This Open Model Thought for 88,000 Characters… and Wrote Zero Code
• Run Qwen 3.8 27B in 8GBs Saluki 27B
• I Ran Liquid’s New Decision Model on an 8GB Laptop. Here’s What Happened.
• Insane Local Testing Qwen-Images-2.1 on my 8GB GPU

Related

llama.cpp, Hugging Face, Ollama, Fahd Mirza, RunPod, OpenBMB, KV cache, Qwen3.8 27B, Qwen3.8 Flash Next, MiMo-V2.6, Apache License 2.0, Qwen3.5 9B