Ilya Sutskever's 30 Essential ML Papers for Beginners
30papers.com – Ilya's 30 essential ML papers, in a beginner friendly format
I curated a list of 30 foundational machine learning papers that I once shared with John Carmack. This collection breaks down complex research into beginner-friendly summaries, making it easier for newcomers to grasp the core concepts that shaped modern AI without getting lost in dense academic jargon.
The most important papers in machine learning are often the ones that seem simplest at first glance.
- notmcrowley
Hey guys, I really appreciate all of the attention this post has received. I honestly thought it was going to be just a small project to help some of my friends get into reading research papers.
A large number of people complained about how intense some of the backgrounds/animations were (I might have been a bit too focused on making something that looked cool over usability). In response I have added toggles for both the movement on the page and the backgrounds for the papers.
Other people mentioned that they would have liked some more personalised reflections on each paper. I currently have already done some of these for the more popular papers on my X @notmcrowley . I would have no problem adding these to the site if people think it will help. I feel the need to warn that I have not been formally educated on ML or AI so any interpretation will just be mine and may not necessarily be the correct one. (If anyone with more experience would like to contribute to this feel free to reach out).
- notmcrowley
Author here. First year CS student at Trinity College Dublin. I Built this because when I was getting into reading research papers I ended up burning a ton of my Claude usage asking questions other people have probably already asked. The website is just a side project and definitely a WIP. Happy to answer questions or take PRs on GitHub.
- clintonc
I wish this were organized according to suggested/logical reading order. For example, the paper introducing the attention mechanism probably ought to precede "attention is all you need".
- lwarfield
For beginners I'd recommend the Welch Labs Illustrated Guide To AI if your not well versed in reading papers. Its a beautiful book that I've enjoyed going through. I'd recommend going through these papers after reading that to get a deep understanding.
- janpmz
After seeing this for the first time, I've build PdfToMp3 to listen to these papers. It has now evolved into ListenDock. Fun fact: PdfToMp3 existed before NotebookLM and I already had "overviews", but I called them teacher explanations.
Here is an example of a "Teacher Explanation" of the paper "Quantifying the Rise and Fall of Complexity in Closed Systems: The Coffee Automaton"
https://listendock.com/e/quantifying_the_rise_and_fall_of_co...
- jawarner
Noting the theory papers on Kolmorogov complexity. For those not familiar, Ilya argues that the reason why neural networks generalize -- why they work at all -- is because they are effectively finding a simple description of their training data, converging down onto the limit of the Kolmorogov complexity. [1]
- theahura
always a fun day when someone rediscovers these. Lucky 10000
in case folks are interested, i wrote up a ~layman's review of each paper over the course of two years a while back. Several of those reviews ended up doing reasonably well on hn. Full analysis of the ~23 docs that were papers and not massive books
https://12gramsofcarbon.com/p/ilyas-30-papers-to-carmack-tab...
- quibono
I was confused for a minute, I thought this was "top 30 papers by Ilya" and was then wondering why "Quantifying the Rise and Fall of Complexity in Closed Systems: The Coffee Automaton" is on the list.
> In additition, even though I have read the vast majority of the papers featured on the website, I have not read through each of the website's versions end to end.
Website's versions, as in - the actual text or the "explanations"? Either way this is a big red flag.