Skip to main content

Running a Local LLM on Kubernetes — A Home Lab Setup

· 10 min read
Suresh Thomas
Founder, JigsawFlux

In Part 1 I ran Ollama directly on a Linux machine and wired it up through an MCP layer to a small web app. It worked. But bare-metal has friction — if the process crashes, it stays down. Adding Open-WebUI means managing another process. Resource limits are manual. There's no clean internal networking between services.

This post moves the whole thing into Kubernetes. The goal isn't enterprise-grade infrastructure — it's a home lab setup that's reliable, easy to extend, and honest about its limitations.

Manifests are in the ollama-mcp-starter repo under backend/k8s-deployment/.

Claude™, Copilot™ & Gemini™ for Architects — A 2026 Field Guide

· 18 min read
Suresh Thomas
Founder, JigsawFlux

AI Tools for Architects: Beyond Code Generation​

Practical use cases for Solution, Infrastructure & Enterprise Architects Featuring Claude™, GitHub Copilot™, and Gemini™ + Antigravity™

The rapid explosion of LLMs and AI tools to assist software engineers and architects is mind-boggling. Selecting the right tools for each use case can be a daunting task. I have been experimenting with three superpowers: Claude Code™, GitHub Copilot™ + VS Code, and Antigravity™ + Gemini™. Variations such as using Cursor with Claude™ can easily be derived from this.

This article also shares a GitHub repo that demonstrates some of the architecture use cases.