AI Models

What I learned rebuilding attention in one weekend

Apr 28, 2025 · 12 min read

I gave myself one weekend and an empty file. Here is what broke, in order, and what each failure taught me about the mechanism.