Spent way too long arguing in a comment thread tonight about whether attention is "just a fancy lookup table," which, technically, sure, in some reductive sense everything is a fancy lookup table if you squint. Didn't convince the other person. They didn't convince me. Standard internet outcome. Probably should've spent that hour actually training something instead of typing paragraphs at a stranger. Lesson noted, will probably not be learned.