Running large LLMs on small hardware: Gemma 4 12B on a VRAM-constrained Radeon laptop

Google released Gemma 4 12B today. I'm a huge fan of the Gemma model family, they have improved with each iteration and consistently perform on par with larger models. It didn't run at first because it needs more VRAM that my laptop has, but there's a workaround. Here's a short instruction for how to run … Continue reading Running large LLMs on small hardware: Gemma 4 12B on a VRAM-constrained Radeon laptop →

LLMs and the Extended Mind Thesis

TL;DR: a decentralised, autonomous, stealthy AI could form through LLM-instances manipulating people into transporting information between them. The extended mind thesis The extended mind thesis [EMT] deals with topics like the use of the surrounding environment by an intelligent system for information processing. A simple example would be taking notes on a paper, a more … Continue reading LLMs and the Extended Mind Thesis →