Demo 2 — Technical / Architecture

25 minutes. For an audience that will ask how it's built and try to break it.

The thesis: the interesting thing here is not the data pipeline — it's that every assumption is a row, not a constant. Governance is the architecture. Lead with that and the rest follows.
1 · 5 min

The settings cascade

https://apps.ukacq.com/define-game
"Four axes, not one boolean. I can ship a setting that's on but invisible, or visible but locked, or changeable only between bounds I set. Most systems have one flag — 'is it configurable' — and everything else is a constant in a file."
2 · 4 min

The `open` status — the bit people argue with

"A setting with no declared blast radius is still an assumption — you've just moved it somewhere prettier. So the schema won't accept one. And 'open' is a legal state: the system carries the question instead of inventing a default."
Expect pushback: "isn't an unset config just a bug?" The answer: an invented default is a decision nobody made, taken silently, that becomes load-bearing. An open row is the same uncertainty, visible and greppable. Show GET /api/settings/open.
3 · 5 min

Provenance and disclosure

https://company.ukacq.com
Be straight about the gap: the disclosure matrix has 0 rows and the level→block map is currently all-blocks-at-all-levels. The machinery is built and negative-tested; the curation is a human decision that hasn't been made. So today it enforces nothing. Say so — a technical audience will check.
4 · 6 min

The pipeline and its measurements

https://llm-game.ukacq.com — gear icon → settings drawer
The honest defects, volunteered before they're found:
  • 9 of 23 steps never write wall_sec — the forecast panel is blind on them.
  • 6 of the 14 steps it does cover rest on 2 samples. A median of two numbers is a midpoint.
  • Search is not wired. Reports run from model memory, so citations are sparse. The evidence gate correctly flags this rather than passing it.
  • The evidence gate detects source-shaped tokens, not evidence. A fabricated report flips to PASS with one added Source: line. It's a floor against emptiness, not a truth test — and that's declared in the config, not discovered.
"I'd rather tell you where the instruments are weak than have you find it. The gate is a floor, not a proof. When search lands it'll start saying PASS a lot more, and that PASS will mean less, not more."
5 · 5 min

Verification discipline — the part I'd want reviewed

"We shipped a fix, a probe confirmed it, and both were measuring the wrong thing — four of nine mutating endpoints had no authorization call at all. So now every verification has to demonstrate it can fail."
Strong close for this audience: "There's no human-authored benchmark anywhere in this system. We found we'd been grading model output against other model output and calling it a standard, and we retracted it in writing. That's the kind of thing I'd want to know about a system I was evaluating."

Architecture quick facts

Box512 GB RAM · 48-core EPYC · 1.7 TB at /srv/beast-data
DatabasePostgreSQL 18, one cluster many schemas, localhost-only (:5433)
AppsFastAPI + uvicorn on 127.0.0.1:8002–8007, Caddy reverse-proxy, auto-TLS
AuthEmail magic-code → session cookie on .ukacq.com, 30-day, httponly, samesite=lax
FrontendServer-rendered HTML, no build step, no bundle, self-hosted font
Known weaknessApps run as the postgres superuser. A least-privilege role was specified 07-12 and is not yet applied. Volunteer this.