Ralph Lozano
I build machine learning systems in financial services. I write about building software with AI, and dig into the code, papers, and algorithms underneath it.
writing
- The Gate in the Middle of the Block
What an activation function does to a signal, from sigmoid to SwiGLU. Saturation, dead units, GELU as an expectation, the gate’s bilinear term, the 2/3 width rule, and variance through depth.
- Sixteen Slots at a Time
How Swiss tables work, from Matt Kulukundis’s CppCon talk to Go 1.24’s map, with step-through demos, a Swiss-table mapping for CPython, and benchmarks.
- How I Trust Code I Didn’t Write
Property testing in the age of AI. Agent-written tests agree with agent-written code; properties, mutation testing, and stateful models are how I get the signal back.