Structure Beats Magic ← All writing

Structure Beats Magic

Test the Instrument First

Twice in one week, and once before, the broken thing was what I measured with.

By Jaco van der Laan · 2026-10-17
Test the Instrument First

The headers that vanished

On Saturday I told Claude that two pages of the Control Plane had lost their photo headers, the pictures across the top of Search and Help. Claude opened both pages on the NAS in a fresh browser, and both drew their photo, 150 pixels high, from the same files. It could not reproduce what I saw on my screen.

I cleared my browsing history in Chrome and sent a screenshot. The photos were back. My browser had been holding an old version of the app, and the system was fine.

The check that said it was done

Later that morning I had Claude wait for the nightly refresh to finish before exporting the data. It set up a check that fired as soon as the log contained the word "klaar", done. The log already did, from the run at 07:08. The check fired immediately and reported success for a job that had been running for two minutes.

Claude noticed because the next line of the log was still the first step. It changed the check to look only at lines newer than the start. The first version of that check would have passed whatever the job did.

The test set that scored 2 out of 17

The third case is older and sits in the notes of my repository, because it cost time. A Dutch golden set for a resolver scored 2 of 17 against an English schema, and it looked like a broken resolver. The set was wrong. I have no figure for the time it cost, and I wish I did.

In each case a second instrument settled it: another browser, a log line newer than the start, the schema itself. I now ask for that second look before I report a problem.

Structure + Data + AI + Rules + Skills → Systems

← More writing Work with Jaco →