BOOK · [4959]
The Minimum Description Length Principle
Science
Grünwald's MIT Press monograph develops the Minimum Description Length principle — a formalization of Occam's razor that frames learning as data compression, where the best model is the one that most compresses the data plus itself. Ilya's reading list points to Grünwald's 'A Tutorial Introduction to the Minimum Description Length Principle,' the condensed precursor to this book; the MDL/compression lens is central to how Ilya talks about generalization and prediction in deep networks.
Endorsed By
1 PERSON-
Ilya Sutskever
Ilya Sutskever's Carmack reading list includes 'A Tutorial Introduction to the Minimum Description Length Principle' by Peter Grünwald — a tutorial paper rather than a standalone book. The catalogue entry uses Grünwald's full MIT Press book of the same subject (paperback ISBN 9780262529631; hardcover 9780262072816, out of print), of which the listed tutorial is the short-form version. Included with this caveat for transparency.
Found on
1 SOURCE- github.com · ilya sutskever recommended reading reading list