← /content
slug: 2018-09-20-commit-log-dump date: 2018-09-20 title: commit log, past two weeks type: git log
Pasting this straight from `git log --oneline` because I don't have the energy to write real sentences tonight and this is honestly a decent record of what actually happened anyway. ``` a3f21c9 fix: attention mask was inverted, explains everything 7d0e441 add: basic checkpointing so I stop losing progress on crashes c88b102 wip: trying local windowed attention, probably broken 1f4a9de revert c88b102, it was broken b209aa1 add: simple logging wrapper around training loop 9e77213 fix: off-by-one in positional encoding for odd sequence lengths 4451dd0 chore: clean up the embarrassing variable names from august 0a8c3ee add: first real config file instead of hardcoded constants e2091ff fix: forgot to zero gradients, three days wasted, never again ``` That third-to-last one — "three days wasted, never again" — is exactly the kind of commit message future-me is going to find funny or humbling depending on how many more times I make some version of that mistake. Betting on more than zero.
2018-09-08-designing-not-just-reproducing.md2018-10-05-a-dumb-off-by-one.md →