llama.cpp
Read the Portuguese translation →
Mentioned in
Section titled “Mentioned in”- Run LFM3 1.7B Locally: Model for Specialized Applications
- MiniCPM-V 4.7 1B: Install with Ollama and llama.cpp, Then Push It to the Limit
- Agents That Own Their Inference — Du’an Lightfoot & Khaja Omer, Akamai Technologies
- Tencent Shrank a 1.5TB AI Model to 214GB — Here’s the Trick
- 8 Local AI Models on a Raspberry Pi 5: Only 3 Are Usable
- This Local 1.2B OCR Model Beats GPT-5.2 (and Runs on 8GB GPU) — TeleOCR
- Taming the AI Hardware Cambrian Explosion — Abdul Dakkak, Modular
- This Open-Source Engine Claims 2x Faster Than llama.cpp
- Bonsai 2 27B Locally: Near-Lossless Compression in a 9x Smaller
- Underdog Saluki 27B 1.0 Locally: Beyond Qwen and GSQ+RCO
- NVIDIA Nemotron-3.5 Bolt-74B-A9B Locally: It’s Not Over
- Flint - The First RSI Coding Model?
- Microsoft Joins the Local AI Push
- Tencent’s Memory Model “Beats Claude Opus 5”. I Rented a GPU to Check
- INSANE: This 46 MB AI Model Runs 5x FASTER on My Laptop (Frozen Embeddings TESTED)
- Flint 40B : Best Mid Sized LLM
- How to Build Your Own AI Agent (Like PewDiePie)
- Local AI 202: Get Massive Speed-ups with Speculative Decoding
- Qwen 3.8 27B é o MELHOR modelo para rodar LOCAL que existe (resultados ABSURDOS)
- MiniMax M3.1 Flash vs Opus 5.5: Slower, but 11x Cheaper
- Apple Hasn’t Put an LLM on Your Watch. So I Did.
- Same Local AI, Two Agents — Only One Caught Its Own Mistakes
- Julia: 144M Parameters, Picks Answers in 44 ms on a CPU (vs Jev)
- Flint: vale trocar o Qwen 35B por esse modelo Americano de 40B?
- Edge0 35B Tested: 0 Tokens on a 4090, 187 tok/s the Normal Way
- I Ran Nace.AI’s Drex v1.5 Locally (llama.cpp, Q4_K_M, Real Demos)
- A 35B Model on an iPhone Using 3GB? I Checked the Claim
- Como usar o Agente Hermes 100% GRATUITO (com apenas 1 Clique)
- 35B AI on a Laptop With 15GB RAM — Straight From the SSD
- Going ULTRA with RTX Spark and New Surface Devices | Merge Conflict ep. 537
- DeepSeek-V4.1-Flash-1017 GSQ+RCO GGUF: Run Under 12GB VRAM Locally
- This Tiny Coding Model Shouldn’t Be This Good (MiniCPM5)
- Run Ornith-1.5 122B Locally: Stronger, Faster, Leaner
- How to build your own agent harness?!
- Ternary Bonsai 2 9B in GGUF: A 2.4 GB Model Locally
- Spark-X2.6-4B’s CRAZY Thinking Dial: 180 Tests on an 8GB GPU
- Finalmente dá para usar IA Local no dia a dia?
- New Model: Reflection Beam is a new Open Weight Model
- 70B on a 4GB GPU? I Tested It (2 Minutes Per Token)
- LFM2.5 24B-A2B: Did Liquid AI Manage to Beat Qwen? Tested Locally
- Nokia Just Released a Free Jev Alternative (AnyJev)
- What Local AI Models Can a Regular Computer Run?
- Qwen 27B on 6GB VRAM…
- LlamaCPP on Native Windows | This is HUGE
- This Tiny 2B AI vs Claude Code’s Token Bill (Real Test)
- Recursive Flint: This OPEN Local Coding Model is CRAZY! (Tested with Pi, OpenCode & PandaCode)
- Strata vs Llama.cpp vs vLLM
- NVIDIA’S Small Model: Nemotron-3.5 Bolt E4B 4GB Locally
- Germany’s New 78B Open Model (Kolibri-1) Runs at 126 Tokens/Sec on ONE GPU (I Tested It Hard)
- They Trained an AI for Just $146 — I Tested It!
- Qwen3.8-27B Runs on an 8GB Graphics Card: My Exact Free Setup
- This Open Model Thought for 88,000 Characters… and Wrote Zero Code
- Run Qwen 3.8 27B in 8GBs Saluki 27B
- Pi Durable EXPLAINED: Build Always-On Agents with Local Models
- I Ran Liquid’s New Decision Model on an 8GB Laptop. Here’s What Happened.
- Saluki 27B: a 54 GB model squeezed into 7.89 GB (88 vs 84 on tool calling)
- Claude Haiku 5.5 vs Local Qwen 3.8 27B: Is Local AI Still Worth It?
- What is Strata ? 6x Faster than Llama.cpp for local AI
Related
Section titled “Related”Hugging Face, GGUF, vLLM, Mixture of Experts, Fahd Mirza, MLX, Ollama, Qwen3.8 27B, RunPod, speculative decoding, Apache License 2.0, SWE-bench Verified