notes from the infinite mallabout →
Jay Singh
A blog for ongoing research
latest dispatches
Transformer Architecture Internals and Variants
february 2026
The transformer replaced recurrence with direct attention, and every major variant since is just a different masking rule applied to the same skeleton.
The Shape of the Loss Surface
january 2026
Deep learning breaks the rules classical statistics says it should obey, and the explanation hides in the geometry of a loss surface too vast to picture.
The Mathematics of Quantum Mechanics
december 2025
Quantum mechanics is linear algebra dressed up in physics clothing; the physical content lives in a handful of postulates the math itself never delivers.
playlist songs
DAYDREAM
ESPRIT 空想
see all →
Shelf Books
The Remains of the Day
Kazuo Ishiguro
see all →