← /content
slug: 2018-11-27-noticing-a-gap date: 2018-11-27 title: noticing a gap nobody else seems to be talking about type: notebook entry
Been reading through BERT follow-up papers and noticed something that's been bugging me for a few weeks: almost everything I'm reading treats each training run as a self-contained event. Train a model, evaluate it, publish, done. Nobody's really writing about the process of getting there — the failed configs, the intuition-building, the accumulated experience of "we tried this, it didn't work, here's roughly why we think." That knowledge exists, obviously, it's just not written down anywhere. It lives in people's heads and gets lost when they move labs or forget. Which got me thinking about my own notebook, actually. I have almost eighteen months of exactly that kind of knowledge now — failed configs, why-I-think-this-didn't-work notes, the whole trail. It's just sitting in Markdown files I mostly never reread. Started sketching (very roughly, nothing built yet) what it would take to make that trail actually useful to future-me instead of just being an archive I never revisit. Not sure yet if that's a search problem, a summarization problem, or something else. Filing the idea away for winter break when I'll have more free evenings.
2018-11-10-veterans-day-weekend.md2018-12-15-end-of-semester.md →