semi-sentient code

Ralph Lozano

Principal ML Engineer

I build machine learning systems in financial services. I write about building software with AI, and dig into the code, papers, and algorithms underneath it.

writing

  1. The Gate in the Middle of the Block

    What an activation function does to a signal, from sigmoid to SwiGLU. Saturation, dead units, GELU as an expectation, the gate’s bilinear term, the 2/3 width rule, and variance through depth.

  2. Sixteen Slots at a Time

    How Swiss tables work, from Matt Kulukundis’s CppCon talk to Go 1.24’s map, with step-through demos, a Swiss-table mapping for CPython, and benchmarks.

  3. How I Trust Code I Didn’t Write

    Property testing in the age of AI. Agent-written tests agree with agent-written code; properties, mutation testing, and stateful models are how I get the signal back.

all writing →