Tagged

TurboQuant

A collection of 7 posts

MOE

Ultimate Guide to LocalLLM Workhorses and Assistants. LLMaxxing on Mini-Bucks < $500 - $1500, plus going higher into the DGX Spark.

We follow up on the current trends of how to get capable and productive LLM's on a limited budget.

LLMs

The World's Most Advanced llama.cpp? A Review of The Tom/llama-cpp-turboquant Revolution.

We take a look at one of the World's most Advanced LLM's that are enabling these world class models to run on small GPU hardware!

MTP

World First! The Tom Pulls TurboQuant w/MTP (and it Works!)

A world first! TurboQuant + MTP support from the same LLama.cpp! What a game changer!

MTP

MTP / TurboQuant Forked Llama.cpp

We hot compile one of the first combo MTP / TurboQuant forks in the world!

Qwen3.5

Qwen3.5-122B-A10B-Q4_K_M.gguf - Run it at 13 Tokens/s with 262,000 Contexts on a Ryzen 9 3900 and a 4080ti. w/128GB RAM.

Qwen3.5-122B-A10B-Q4_K_M.gguf - Run it at 13 Tokens/s with 262,000 Contexts on a Ryzen 9 3900 and a 4080ti. w/128GB RAM.

TurboQuant

The TurboQuant BreakThrough. Running Qwen3.5-35B-A3B-UD-IQ3_XXS.gguf with a Hermes Agent. Get $80K Enterprise Server Performance on a $800 House GPU.

The TurboQuant BreakThrough. Running Qwen3.5-35B-A3B-UD-IQ3_XXS.gguf with a Hermes Agent. Get $80K Enterprise Server Performance on a House GPU.

LLMs

LLM Diet Recipes! Reducing LLM Costs!

We Kick Up-Selling LLM Services to the Curb and Look at Other Options. You can do a LOT for free.