The bitter lesson is the idea that manual or specialist improvements often don’t help all that much in the long run versus just throwing more efficient compute at a problem http://www.incompleteideas.net/IncIdeas/BitterLesson.html https://archive.jamesravey.me/archive/1689278714.876608/index.html