wikis / Local AI Infrastructure / README.md

Local AI Infrastructure Knowledge Base

type: namespace-overview

confidence: high

updated: 2026-07-17

status: active

namespace: local-ai-infrastructure

updated: 2026-07-17

Covers

Local-first AI setup, local LLMs, LoRA/fine-tuning infrastructure, RAG over compiled wikis, deterministic local workflow offload, and hardware/software constraints.

Not Covered

Cloud-only infrastructure unless it affects local-first migration; product UX unless tied to local model constraints.

Current As Of

2026-07-17 — active. Includes local retrieval/RAG concepts, VPS app operation, and the LKY Brain consumer-GPU QLoRA case study with checkout-portable launchers, documented PEFT/vLLM paths, executed downstream llama.cpp Q4_K_M serving, tuned-voice co-placement, and the application-layer audited retrieval seam used by LKY Avatar.

Agent access: /wiki/local-ai-infrastructure/llms.txt /wiki/local-ai-infrastructure/llms-full.txt /wiki/local-ai-infrastructure/index.json

Local-first AI setup, local LLMs, LoRA/fine-tuning infrastructure, RAG over compiled wikis, deterministic local workflow offload, and hardware/software constraints.

Structure

raw/ — raw Markdown provenance mirror for agents and source inspection.
wiki/ — synthesized knowledge pages: concepts, entities, summaries, and syntheses.
Schema and maintenance rules: see CLAUDE.md.

Usage

Add new sources: update canonical source notes in pixi-vault, then compile into this namespace.
Ask questions: agents read this wiki and cite raw/source paths.
Publish: regenerate pixi-wiki, run tests, then live-verify raw and HTML routes.

Local AI Infrastructure¶

Active namespace for local-first models, retrieval, fine-tuning, deployment, and hardware/software constraints.

Canonical Source Roots¶

Knowledge/concepts/local-retrieval-agent-infrastructure.md
Knowledge/concepts/rag-over-agent-wikis.md
Projects/LKY Archive/Index.md
Projects/LKY Avatar/Index.md

Crosslinks¶

pixi-vault
curated-tuning-datasets
rl-sim-labs

Public Output Contract¶

When published to pixi-wiki, this namespace should expose:

/raw/local-ai-infrastructure/README.md
/raw/local-ai-infrastructure/wiki/index.md
/wiki/local-ai-infrastructure/README.md
/wiki/local-ai-infrastructure/wiki/index.md

Maintenance¶

Edit canonical source notes first.
Use Wiki Compiler Maps/Namespace Wiki Compiler Map.md for routing decisions.
Do not compile Daily Notes directly unless promoted or verified.