semi-sentient code

Writing

3 posts · rss

  1. The Gate in the Middle of the Block

    What an activation function does to a signal, from sigmoid to SwiGLU. Saturation, dead units, GELU as an expectation, the gate’s bilinear term, the 2/3 width rule, and variance through depth.

  2. Sixteen Slots at a Time

    How Swiss tables work, from Matt Kulukundis’s CppCon talk to Go 1.24’s map, with step-through demos, a Swiss-table mapping for CPython, and benchmarks.

  3. How I Trust Code I Didn’t Write

    Property testing in the age of AI. Agent-written tests agree with agent-written code; properties, mutation testing, and stateful models are how I get the signal back.