Wonders

Key research papers on deep learning

The 2015 Nature review, Schmidhuber's overview, PyTorch, landmark applications in medicine and science, and the reviews that map a very large field.

Data from OpenAlex, retrieved September 21, 2026

In short

Deep learning is too large to review as a whole: OpenAlex lists more than 340,000 works with the phrase in the title, about 68,000 of them from 2025. Read LeCun, Bengio and Hinton (2015) for the concepts, Schmidhuber (2015) for the history, and then go straight to a survey for your application area, such as Litjens et al. (2017) for medical imaging. Many architecture papers (on convolutional networks, residual networks and transformers) do not have deep learning in the title, so they are missing here by construction.

How the literature is organised

Deep learning is a set of methods, and its literature is organised by architecture, task and application domain, not by competing theories. Two overview papers from 2015 serve as the common reference. LeCun, Bengio and Hinton explain representation learning, backpropagation, convolutional and recurrent networks in nine pages. Schmidhuber gives a historical survey that, in its own words, summarises relevant work, much of it from the previous millennium.

After that the most-cited papers divide into tools, methods and landmark applications. Tools: the PyTorch paper (Paszke et al., 2019). Methods: data augmentation (Shorten and Khoshgoftaar, 2019), physics-informed neural networks (Raissi, Perdikaris and Karniadakis, 2019), object detection reviewed by Zhao et al. (2019). Applications: Gulshan et al. (2016) validated a deep learning algorithm for detecting diabetic retinopathy in retinal photographs against grading by ophthalmologists; Litjens et al. (2017) surveyed medical image analysis; Mathis et al. (2018) introduced DeepLabCut for tracking animal movement; Reichstein et al. (2019) set an agenda for Earth system science.

Main debates

Why do very large networks generalise at all? Zhang et al. (2021), "Understanding deep learning (still) requires rethinking generalization", show through systematic experiments that the traditional explanations fail to account for it, and the paper is the most-cited entry to that question on this page. A second issue with a review of its own is uncertainty (Abdar et al., 2021, on its quantification). Opacity has a literature of its own, listed on the explainable AI page.

Where recent work is heading

General reviews by Alzubaidi et al. (2021) and Sarker (2021) give current taxonomies. Specialised reviews cover attention mechanisms (Niu, Zhong and Yu, 2021), ensembles (Ganaie et al., 2022), anomaly detection (Pang et al., 2022) and time-series forecasting (Lim and Zohren, 2021). The most-cited recent applications are in biomedicine: nnU-Net for segmentation (Isensee et al., 2021) and ProteinMPNN for protein sequence design (Dauparas et al., 2022).

Most-cited foundational papers

Published before 2021 and ranked by how often later work cites them. Read the abstract of each and the full text of the three or four closest to your question. Citation count measures attention, not quality, so treat this as a map of what the field has argued about rather than a ranking of what is true.

  1. 1
    Deep learning

    Yann LeCun, Yoshua Bengio, Geoffrey Hinton (2015). Nature.

    Cited by 84,785Open accessdoi:10.1038/nature14539

  2. 2
    Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations

    M. Raissi, P. Perdikaris, G.E. Karniadakis (2019). Journal of Computational Physics.

    Cited by 19,651Open accessdoi:10.1016/j.jcp.2018.10.045

  3. 3
    Deep learning in neural networks: An overview

    Jürgen Schmidhuber (2015). Neural Networks.

    Cited by 18,289Open accessdoi:10.1016/j.neunet.2014.09.003

  4. 4
    PyTorch: An Imperative Style, High-Performance Deep Learning Library

    Adam Paszke and 20 others (2019). arXiv (Cornell University).

    Cited by 16,139Open accessdoi:10.48550/arxiv.1912.01703

  5. 5
    A survey on deep learning in medical image analysis

    Geert Litjens and 8 others (2017). Medical Image Analysis.

    Cited by 15,259Open accessdoi:10.1016/j.media.2017.07.005

  6. 6
    A survey on Image Data Augmentation for Deep Learning

    Connor Shorten, Taghi M. Khoshgoftaar (2019). Journal of Big Data.

    Cited by 13,118Open accessdoi:10.1186/s40537-019-0197-0

  7. 7
    Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs

    Varun Gulshan and 14 others (2016). JAMA.

    Cited by 7,863doi:10.1001/jama.2016.17216

  8. 8
    DeepLabCut: markerless pose estimation of user-defined body parts with deep learning

    Alexander Mathis and 6 others (2018). Nature Neuroscience.

    Cited by 5,821Open accessdoi:10.1038/s41593-018-0209-y

  9. 9
    Deep learning and process understanding for data-driven Earth system science

    Markus Reichstein and 6 others (2019). Nature.

    Cited by 5,587Open accessdoi:10.1038/s41586-019-0912-1

  10. 10
    Object Detection With Deep Learning: A Review

    Zhong-Qiu Zhao and 3 others (2019). IEEE Transactions on Neural Networks and Learning Systems.

    Cited by 5,500doi:10.1109/tnnls.2018.2876865

Most-cited papers since 2021

Primary studies and conceptual papers from 2021 onwards. A paper published in 2024 has had a few years to accumulate citations where the works in the section above have had decades, so compare these counts with each other rather than with the ones above.

  1. 1
    nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation

    Fabian Isensee and 4 others (2021). Nature Methods.

    Cited by 9,553Open accessdoi:10.1038/s41592-020-01008-z

  2. 2
    Deep Learning for Anomaly Detection: A Review

    Guansong Pang and 3 others (2022). ACM Computing Surveys.

    Cited by 2,677Open accessdoi:10.1145/3439950

  3. 3
    Machine learning and deep learning

    Christian Janiesch, Patrick Zschech, Kai Heinrich (2021). Electronic Markets.

    Cited by 2,629Open accessdoi:10.1007/s12525-021-00475-2

  4. 4
    Understanding deep learning (still) requires rethinking generalization

    Chiyuan Zhang and 4 others (2021). Communications of the ACM.

    Cited by 2,392Open accessdoi:10.1145/3446776

  5. 5
    Deep Learning for Person Re-Identification: A Survey and Outlook

    Mang Ye and 5 others (2022). IEEE Transactions on Pattern Analysis and Machine Intelligence.

    Cited by 2,230doi:10.1109/tpami.2021.3054775

  6. 6
    Robust deep learning–based protein sequence design using ProteinMPNN

    J. Dauparas and 21 others (2022). Science.

    Cited by 2,087Open accessdoi:10.1126/science.add2187

  7. 7
    Text Data Augmentation for Deep Learning

    Connor Shorten, Taghi M. Khoshgoftaar, Borko Furht (2021). Journal of Big Data.

    Cited by 1,707Open accessdoi:10.1186/s40537-021-00492-0

  8. 8
    Deep Learning Enabled Semantic Communication Systems

    Huiqiang Xie and 3 others (2021). IEEE Transactions on Signal Processing.

    Cited by 1,570Open accessdoi:10.1109/tsp.2021.3071210

Recent reviews and meta-analyses

The fastest way into a literature. A good review gives you the structure of the field, a reference list to mine and, in its limitations section, the gaps other researchers have already spotted.

  1. 1
    Review of deep learning: concepts, CNN architectures, challenges, applications, future directions

    Laith Alzubaidi and 9 others (2021). Journal of Big Data.

    Cited by 7,912Open accessdoi:10.1186/s40537-021-00444-8

  2. 2
    A review on the attention mechanism of deep learning

    Zhaoyang Niu, Guoqiang Zhong, Hui Yu (2021). Neurocomputing.

    Cited by 3,381doi:10.1016/j.neucom.2021.03.091

  3. 3
    A review of uncertainty quantification in deep learning: Techniques, applications and challenges

    Moloud Abdar and 11 others (2021). Information Fusion.

    Cited by 2,695Open accessdoi:10.1016/j.inffus.2021.05.008

  4. 4
    Deep Learning: A Comprehensive Overview on Techniques, Taxonomy, Applications and Research Directions

    Iqbal H. Sarker (2021). SN Computer Science.

    Cited by 2,551Open accessdoi:10.1007/s42979-021-00815-1

  5. 5
    Ensemble deep learning: A review

    M.A. Ganaie and 4 others (2022). Engineering Applications of Artificial Intelligence.

    Cited by 2,152Open accessdoi:10.1016/j.engappai.2022.105151

  6. 6
    Time-series forecasting with deep learning: a survey

    Bryan Lim, Stefan Zohren (2021). Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

    Cited by 1,785Open accessdoi:10.1098/rsta.2020.0209

How big the literature is, and where it is published

OpenAlex indexes 343,352 works whose title matches this topic. The chart shows how many were published each year from 2000 to 2025; the current year is left out because it is incomplete.

2000: 7 works720002001: 10 works2002: 14 works2003: 16 works2004: 14 works2005: 30 works2006: 27 works2007: 22 works2008: 28 works2009: 45 works2010: 57 works2011: 89 works2012: 110 works2013: 179 works2014: 398 works2015: 832 works2016: 1,853 works2017: 4,521 works2018: 9,454 works2019: 15,942 works2020: 22,718 works2021: 29,226 works2022: 34,899 works2023: 43,789 works2024: 53,338 works2025: 67,955 works67,9552025
Show the numbers as a table
YearWorks
20007
200110
200214
200316
200414
200530
200627
200722
200828
200945
201057
201189
2012110
2013179
2014398
2015832
20161,853
20174,521
20189,454
201915,942
202022,718
202129,226
202234,899
202343,789
202453,338
202567,955

Journals behind the most-cited work

Counted across the 170 most-cited works on the topic, not across everything published. Browsing recent issues of the first two or three is a reliable way to find current work that has not yet been cited much.

Sub-topics to narrow into

A thesis-sized question usually sits inside one of these, combined with a population or a setting.

How to cite these papers

Every paper above has a DOI, a part of the reference that is easy to leave out. Here is one of them, “Deep learning” (2015), in the two styles students ask about most:

APA 7th edition

LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature, 521(7553), 436–444. https://doi.org/10.1038/nature14539

MLA 9th edition

LeCun, Yann, et al. “Deep Learning.” Nature, vol. 521, no. 7553, 2015, pp. 436–44, https://doi.org/10.1038/nature14539.

Check the details against the article itself before you submit: databases, including the one behind this page, sometimes carry the online-first year rather than the volume year. Full rules and more examples are in our guides to APA, MLA, Chicago, Harvard, Vancouver and ABNT, with the rest in the citation guides. You can also format a reference from its DOI with our free citation tools.

Frequently asked questions

What is the most cited deep learning paper?

Among works with the phrase in the title it is LeCun, Bengio and Hinton (2015) in Nature, with about 85,000 citations in OpenAlex. Some architecture papers without the phrase in their titles are cited even more, which is a limitation of any title-based list.

How do I write a literature review on such a large topic?

Do not review deep learning; review deep learning for one task in one domain, over a stated period. Start from a recent survey in that niche, check who cites it, and use a structured protocol so that your inclusion decisions are defensible. Our literature review guides explain how to document a search.

Why is a software paper (PyTorch) among the most cited?

Paszke et al. (2019) describes the PyTorch library, and researchers cite it when they use it. As with database papers in biology, the citation count reflects use as a tool. Cite it if you use PyTorch, not as evidence for a claim.

How this page was made

The lists come from OpenAlex, an open index of scholarly works whose data are published under a CC0 licence, queried on September 21, 2026 for works whose title matches "deep learning". Only works with a DOI are listed. Each one was checked against the publisher’s own record at Crossref or DataCite (title, year, first author, journal, volume and pages), and in three cases, where the publisher deposited no byline, against PubMed; anything OpenAlex or Crossref flags as retracted was left out, and an editor took out results that matched the words but not the subject. Citation counts are OpenAlex’s on that date and are usually lower than Google Scholar’s, which counts more kinds of document. Ranking by citations tells you what a field has relied on, not what is correct; several heavily cited papers on any topic are cited because later work disputes them. Books without a DOI are missing, which matters in fields where the founding text is a book.

Related research topics

Find your own gap.

Search 320M+ scholarly works on deep learning, keep what matters on a board, and export the references. 14 days free. Students get 50% off.

Start with this topic →