Tagged

Llama.cpp

A collection of 9 posts

Qwythos

9B Powerhouse? We look at Qwythos-9B-Claude-Mythos-5-1M-GGUF. 70-95T/s on a 4080. A LLM Boosters Dream Build.

We take a look at Qwythos and definitely were impressed!

3060ti

Game Changer! Crash-Out! Good Production on a Ryzen 5 2600 (6-core/12thread AMD) w 3060ti/8GB VRAM

Crash-Out! Good Production on a Ryzen 5 2600 w 3060ti/8GB VRAM. We showed you can actually get very powerful productive capability on a 3060ti!

Gemma4

The Hunt for the Perfect 8b - Try -01 Gemma4-12 v2 Inspection.. Can we get a powerhouse LLM inside a 8GB.. You decide.

We review a mucle-tuned powerhouse of a homeLLM. The rocking 8GB Gemma4-v2 tuned for coders and agentic tasks.

benchmarking

LocalLLM BenchMaxxing! How to Benchmark llama.cpp and power juice your localLLMs!

We go over benchmaxxing your localLLM in a custom Llama.cpp!

MCP Server

Agentic Server Primer: Llama.cpp MCP Lesson 10: mcp-coder (Cuda Version)

We build a MCP Coding Agent that will allow your LLM to specifically work on and debug it's own code with nvcc, or really any language!

docker

Agentic Server Primer: Llama.cpp MCP Lesson 6: Adding mysql Database Docker Toolsets.

We give our LLM it's own Database to play with!

Qwen3.5

Qwen3.5-122B-A10B-Q4_K_M.gguf - Run it at 13 Tokens/s with 262,000 Contexts on a Ryzen 9 3900 and a 4080ti. w/128GB RAM.

Qwen3.5-122B-A10B-Q4_K_M.gguf - Run it at 13 Tokens/s with 262,000 Contexts on a Ryzen 9 3900 and a 4080ti. w/128GB RAM.

House LLM

Agentic Server Primer: Llama.cpp MCP Lesson 3: Adding Python Tooling Capability To your HouseLLM.

Agentic Server Primer: Llama.cpp MCP Lesson 3: Python

agentic

Agentic Server Primer: Llama.cpp MCP Lesson 1: A Calculator.

Agentic Server Primers: Llama.cpp MCP Lession 1: A Calculator