LLMs - Hot Config

9B Powerhouse? We look at Qwythos-9B-Claude-Mythos-5-1M-GGUF. 70-95T/s on a 4080. A LLM Boosters Dream Build.

We take a look at Qwythos and definitely were impressed!

The World's Most Advanced llama.cpp? A Review of The Tom/llama-cpp-turboquant Revolution.

We take a look at one of the World's most Advanced LLM's that are enabling these world class models to run on small GPU hardware!

HomeLLM

Ornith 1.0 Breakout - the HouseLLM BenchMaxx? Builds a CNN (Convolutional Neural Network) on the first Prompt!

Ornith 1.0 a MIT licensed supermodel gives crushing results, and very good performance!

MTP

Into the MTP Zone.. A Look at Multi-Token-Prediction - It Rocks!

We foray into MTP (Multiple Token Prediciton)

docker

Agentic Server Primer: Llama.cpp MCP Lesson 9: Docker Orchestrator

In this guide we go over letting your llm manage and create it's own docker images, stand up it's own containers after writing it's code. It uses a special docker-compose tool we built for it.

LLMs

LLM Diet Recipes! Reducing LLM Costs!

We Kick Up-Selling LLM Services to the Curb and Look at Other Options. You can do a LOT for free.