OpenAI Product Presentation Deck

Tesauro with TD-Gammon (1992) History of AI-alternate narrative Deep learning has consistently scaled with compute for 60 years New levels of compute steers researchers to develop new algorithms such as backpropagation, not the other way around Fads have been more political than technical "It took great chutzpah for Gerald Tesauro to start wasting computer cycles on temporal difference learning in the game of Backgammon" ([32k parameters; total training: 5s on modern GPU] -Pollack & Blair (1997)

View entire presentation