Deep Learning Foundation
Awesome Deep Learning Foundations (2012–2016)
Trace the origins of the AI revolution. This curated collection features the seminal deep learning papers published between 2012 and 2016—the era that birthed modern computer vision and natural language processing. From the breakthrough of AlexNet (ImageNet) and the introduction of Dropout, to the architectural leaps of VGG, Inception, and ResNet. This roadmap provides a structured path for understanding the mathematical and architectural foundations that power today’s Large Language Models (LLMs) and Generative AI. Mastery of Artificial Intelligence begins with the classics. This guide provides a hand-picked selection of highly-cited deep learning papers published between 2012 and 2016. These works introduced the world to Convolutional Neural Networks (CNNs), Generative Adversarial Networks (GANs), and Recurrent Neural Networks (RNNs). Explore the seminal research that serves as the backbone for today's Large Language Models and autonomous systems.
- Hado van Hasselt, Arthur Guez, David Silver20157,936 checkouts
- David Silver, Aja Huang, Chris J. Maddison, Arthur Guez, Laurent Sifre, George van den Driessche, Julian Schrittwieser, Ioannis Antonoglou, Veda Panneershelvam, Marc Lanctot, Sander Dieleman, Dominik Grewe, John Nham, Nal Kalchbrenner, Ilya Sutskever, Timothy Lillicrap, Madeleine Leach, Koray Kavukcuoglu, Thore Graepel, Demis Hassabis20165,022 checkouts
- Timothy P. Lillicrap, Jonathan J. Hunt, Alexander Pritzel, Nicolas Heess, Tom Erez, Yuval Tassa, David Silver, Daan Wierstra20195,083 checkouts
- Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wierstra, Martin Riedmiller20139,587 checkouts
- Jimmy Lei Ba, Jamie Ryan Kiros, Geoffrey E. Hinton20166,011 checkouts
- Marcin Andrychowicz, Misha Denil, Sergio Gomez, Matthew W. Hoffman, David Pfau, Tom Schaul, Nando de Freitas20167,134 checkouts
- Aaron van den Oord, Sander Dieleman, Heiga Zen, Karen Simonyan, Oriol Vinyals, Alex Graves, Nal Kalchbrenner, Andrew Senior, Koray Kavukcuoglu20168,716 checkouts
- Richard Zhang, Phillip Isola, Alexei A. Efros20166,054 checkouts
- Jun-Yan Zhu, Philipp Krähenbühl, Eli Shechtman, Alexei A. Efros20186,297 checkouts
- Wei Liu, Dragomir Anguelov, Dumitru Erhan, Christian Szegedy, Scott Reed, Cheng-Yang Fu, Alexander C. Berg20167,013 checkouts
- Forrest N. Iandola, Song Han, Matthew W. Moskewicz, Khalid Ashraf, William J. Dally, Kurt Keutzer20169,585 checkouts
- Song Han, Xingyu Liu, Huizi Mao, Jing Pu, Ardavan Pedram, Mark A. Horowitz, William J. Dally20167,906 checkouts
- Matthieu Courbariaux, Itay Hubara, Daniel Soudry, Ran El-Yaniv, Yoshua Bengio20168,124 checkouts
- Yonghui Wu, Mike Schuster, Zhifeng Chen, Quoc V. Le, Mohammad Norouzi, Wolfgang Macherey, Maxim Krikun, Yuan Cao, Qin Gao, Klaus Macherey, Jeff Klingner, Apurva Shah, Melvin Johnson, Xiaobing Liu, Łukasz Kaiser, Stephan Gouws, Yoshikiyo Kato, Taku Kudo, Hideto Kazawa, Keith Stevens, George Kurian, Nishant Patil, Wei Wang, Cliff Young, Jason Smith, Jason Riesa, Alex Rudnick, Oriol Vinyals, Greg Corrado, Macduff Hughes, Jeffrey Dean20168,881 checkouts
- Andrew G. Howard, Menglong Zhu, Bo Chen, Dmitry Kalenichenko, Weijun Wang, Tobias Weyand, Marco Andreetto, Hartwig Adam20175,716 checkouts
- Jonas Gehring, Michael Auli, David Grangier, Denis Yarats, Yann N. Dauphin20179,257 checkouts
- Marjan Ghazvininejad, Chris Brockett, Ming-Wei Chang, Bill Dolan, Jianfeng Gao, Wen-tau Yih, Michel Galley20189,000 checkouts
- Yuxuan Wang, RJ Skerry-Ryan, Daisy Stanton, Yonghui Wu, Ron J. Weiss, Navdeep Jaitly, Zongheng Yang, Ying Xiao, Zhifeng Chen, Samy Bengio, Quoc Le, Yannis Agiomyrgiannakis, Rob Clark, Rif A. Saurous20177,302 checkouts
- Fujun Luan, Sylvain Paris, Eli Shechtman, Kavita Bala20176,267 checkouts
- Tim Salimans, Jonathan Ho, Xi Chen, Ilya Sutskever20178,582 checkouts
FAQ
What is Deep Learning Foundation?
Deep Learning Foundation is an expert-curated awesome list on Attendemia that groups high-signal resources for fast learning. Items are reviewed and refreshed over time, so readers can start with a practical shortlist instead of searching across fragmented sources and low-context recommendation threads.
How are items ranked here?
Items are ranked using maintainer curation, content quality notes, engagement momentum, and freshness indicators. This ranking method keeps the top of the awesome list actionable for current workflows, while still preserving evergreen references that are widely cited and useful for deeper technical understanding.
Can I follow this list?
Yes. Use the follow button near the page header to receive update visibility when new resources are added or promoted. Following this list helps you monitor changes without rechecking manually and keeps your learning feed aligned with this specific topic over time.