Tagged

House LLM

A collection of 7 posts

House LLM

Agentic Server Primer: Llama.cpp MCP Lesson 8: Process Manager Web Enabled Research Assistant w/ Code Drop.

Agentic Server Primer: Llama.cpp MCP Lesson 8: Process Manager Web Enabled Research Assistant

Qwen3-Coder

Qwen3-Coder-Next-UD-Q4-K_XL.gguf on a Ryzen 9/4080ti. Run a 48GB SOTA Tensor-Balanced on a $2K set of House Parts.

We field test a Qwen3-Coder-Next-UD-Q4_K_XL.gguf

llmfit

llmfit - Fast LLM Metric Fitter and Pulling Tool

We have a look at a fast fitting tool for comparing our hardware to the LLM market.

House LLM

Agentic Server Primer: Llama.cpp MCP Lesson 3: Adding Python Tooling Capability To your HouseLLM.

Agentic Server Primer: Llama.cpp MCP Lesson 3: Python

TurboQuant

The TurboQuant BreakThrough. Running Qwen3.5-35B-A3B-UD-IQ3_XXS.gguf with a Hermes Agent. Get $80K Enterprise Server Performance on a $800 House GPU.

The TurboQuant BreakThrough. Running Qwen3.5-35B-A3B-UD-IQ3_XXS.gguf with a Hermes Agent. Get $80K Enterprise Server Performance on a House GPU.

hermes

Hermes Review. Basic LLM / OpenRouter.ai Setup Example with Guardrail.

We took an honest effort at getting Hermes to work.

LLM

LLM TurboQuant Example! Qwen3.5 27B Agentic Workflow Primer. Saving $900/month in Tokens Speed Running our House LLM and Clobbering the Claudes.. (Part 3)

LLM TurboQuant Example! Qwen3.5 27B Agentic Workflow Primer. Speed Running our House LLM.