LLM - Hot Config

LLM Image Generation on Dual 3060ti Video Cards Using stability_ai.

With Stability_ai we are able to generate beautiful images at about 18 seconds / shot using 2 -3060ti cards in a balanced load.

Audio

Audio LLM audio-flamingo-3-hf Text-to-Speech / Speech-to-Text

TensorTrade

TensorTrade - LLM Reinforcement Learning Model for Algorithmic Training for the Stock Market.

pufferfish

PufferLib - Reinforcement Learning at 1 Million Steps / Second.

Llama

LM Studio 0.3.30 (Build 1) Awesome! Run LLM's At Your House Without Being A Coder. A Basic Review

3060ti

Running the LLM Ring-Mini 2.0 16B on Ryzen 9 w/2 3060ti Nvidia GPUs.

Running the Ring-Mini 2.0 16B on Ryzen 9 w/2 3060ti Nvidia GPUs.

3060ti

Speed Comparisons GPU/CPU vs CPU only. Running Magistral-24B on a Budget.

Speed Comparisons GPU/CPU vs CPU only. Running Magistral-24B on a budget.

LLM

LLM Workups: Grok 4: Tower+ 9B from Unbabel. Penny-Wise Translators 11 token/per/second on a bottom-end 3060ti GPU in 4-bit mode.

LLM Workups: Grok 4: Tower+ 9B from Unbabel. Penny-Wise Translators.

LLM

LLM Workups: Running BLOOMZ 7.1B on a 3060ti.

LLM

LLM Workups: Running Falcon3-7b on a Minimal 3060ti Ryzen 9.

AI

The Great AI Explosion (Part 4 - Running a 3b Coding Parameter Model from HuggingFace)

In this example we run a small 3b 12 language coding model on modest GPU/CPU parts namely a 3060ti on a Ryzen R9. It works remarkably well!

AI

The Great AI Explosion - Transformative Development (Part 2 - Levels of Coding Automation)

In this article we go over the current leader boards that track LLM's, and METR - which is tracking the current progress of LLM's in replacing software developers.

AI

The Great AI Explosion - The Migration to AI and Agentic Systems (Part 1 - Introductions)

We go over the explosion of LLM (Large Language Models) and some examples of their current capabilities.