self-hosted · always-on

A home for machines
that never sleep.

ISOCAST is a personal AI lab running entirely on hardware at home — a mesh of nodes serving local language models, image & video generation, and autonomous agents.

No cloud bills, no rented GPUs. Just metal, fans, and a lot of late nights tuning it.

otto@isocast:~$ uptime
   mesh online — local LLMs, diffusion & agents ready
// compute

The numbers

Compute pooled across the lab — used for model inference, training experiments, and rendering.

6
nodes
8
GPUs
~75GB
total VRAM
~50
CPU cores
400GB+
RAM
// the rig

Nodes in the mesh

Each box has a job. Together they run an LLM mesh, generation pipelines, and a wall of background workers.

primary

The brain

  • CPU i9-10900K · 10c/20t
  • GPU RTX 4060 Ti
  • OS Kali Linux
  • Role orchestration · agents
workload

The workhorse

  • CPU Xeon W · ECC
  • RAM 256 GB ECC
  • GPU Quadro P4000
  • Role always-on inference
ai node

Dual-GPU

  • CPU i5-9600K
  • GPU P4000 + 1080 Ti
  • OS Ubuntu
  • Role parallel model serving
workstation

The big iron

  • CPU i9-13900KF · 24c/32t
  • RAM 64 GB DDR5
  • GPU RTX 5060
  • Role dev · local models
gpu node

The render farm

  • GPU 4× RTX 3060 Ti
  • VRAM 32 GB pooled
  • Role 30B+ model hosting
  • Link tunneled
edge

The little one

  • Host MacBook Pro
  • Role second opinion
  • Use parallel agent runs
  • Status online
// services

What runs here

Everything self-hosted — the goal is to own the whole stack, end to end.

🧠

A local LLM mesh

Dozens of open models served across the nodes — code, reasoning, vision and embeddings — load-balanced for parallel work without a single cloud token.

🎨

Image generation

Diffusion pipelines (Krea / Qwen-Image on ComfyUI) generating high-res images locally on the GPUs.

🎬

Video generation

Text-to-video (LTXV) producing short clips on consumer hardware — up to 1080p, right at home.

🤖

Autonomous agents

Swarms of coordinated agents handling research, code, and review — running around the clock in the background.

📊

Live dashboards

Custom monitors keeping an eye on every node, GPU and worker — so nothing runs silently into the ground.

🛡️

Hardened & watched

The whole estate is firewalled, patched and monitored — a lab that's locked down as carefully as it's built.