Welcome to the new version of CaltechAUTHORS. Login is currently restricted to library staff. If you notice any issues, please email coda@library.caltech.edu
Published November 2016 | Published + Supplemental Material
Journal Article Open

Deep Learning Automates the Quantitative Analysis of Individual Cells in Live-Cell Imaging Experiments

Abstract

Live-cell imaging has opened an exciting window into the role cellular heterogeneity plays in dynamic, living systems. A major critical challenge for this class of experiments is the problem of image segmentation, or determining which parts of a microscope image correspond to which individual cells. Current approaches require many hours of manual curation and depend on approaches that are difficult to share between labs. They are also unable to robustly segment the cytoplasms of mammalian cells. Here, we show that deep convolutional neural networks, a supervised machine learning method, can solve this challenge for multiple cell types across the domains of life. We demonstrate that this approach can robustly segment fluorescent images of cell nuclei as well as phase images of the cytoplasms of individual bacterial and mammalian cells from phase contrast images without the need for a fluorescent cytoplasmic marker. These networks also enable the simultaneous segmentation and identification of different mammalian cell types grown in co-culture. A quantitative comparison with prior methods demonstrates that convolutional neural networks have improved accuracy and lead to a significant reduction in curation time. We relay our experience in designing and optimizing deep convolutional neural networks for this task and outline several design rules that we found led to robust performance. We conclude that deep convolutional neural networks are an accurate method that require less curation time, are generalizable to a multiplicity of cell types, from bacteria to mammalian cells, and expand live-cell imaging capabilities to include multi-cell type systems.

Additional Information

© 2016 Van Valen et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Received: May 18, 2016; Accepted: October 3, 2016; Published: November 4, 2016. Editor: Martin Meier-Schellersheim, National Institutes of Health, UNITED STATES We gratefully acknowledge funding from several sources, including a Paul Allen Family Foundation Allen Distinguished Investigator award, a Paul Allen Family Foundation Allen Discovery Center Award and an NIH Pioneer Award (5DP1LM01150-05) to MWC, a Systems Biology Center grant (P50 GM107615), a DOE Computational Science Graduate Fellowship (DE-FG02-97ER25308) and a Siebel Scholarship to DNM, and a Stanford Biomedical Big Data Science Postdoctoral Fellowship as well as the Burroughs Wellcome Fund's Postdoctoral Enrichment Program and an NIH F32 Postdoctoral Fellowship (1F32GM119319-01) to DVV. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. We gratefully acknowledge funding from several sources, including a Paul Allen Family Foundation Allen Distinguished Investigator award, a Paul Allen Family Foundation Allen Discovery Center Award and an NIH Pioneer Award (5DP1LM01150-05) to MWC, a Systems Biology Center grant (P50 GM107615), a DOE Computational Science Graduate Fellowship (DE-FG02-97ER25308) and a Siebel Scholarship to DNM, and a Stanford Biomedical Big Data Science Postdoctoral Fellowship as well as the Burroughs Wellcome Fund's Postdoctoral Enrichment Program and an NIH F32 Postdoctoral Fellowship (1F32GM119319-01) to DVV. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. We are deeply grateful to a number of people for advice, assistance with experiments, and critical commentary on the manuscript, including Zev Bryant, Joe Levine, Fei Fei Li, Andrej Karpathy, Henrietta Lacks, Amanda Miguel, K.C. Huang, Robert Brewster, Rob Phillips, John Phillips, Jan Liphardt, Andy Spakowitz, and members of the Covert lab. Author Contributions Conceptualization: DAVV MWC. Data curation: DAVV KML NTQ MMD IM. Formal analysis: DAVV. Funding acquisition: DAVV TK KML DNM NTQ MMD IM YT EAA MWC. Investigation: DAVV TK KML DNM NTQ MMD IM YT EAA MWC. Methodology: DAVV. Project administration: DAVV MWC. Resources: DAVV TK KML DNM NTQ MMD IM YT. Software: DAVV TK DNM NTQ. Supervision: EAA MWC. Validation: DAVV MMD KML IM YT NTQ. Visualization: DAVV. Writing – original draft: DAVV MWC. Writing – review & editing: DAVV TK KML DNM NTQ MMD IM YT EAA MWC. Data Availability: All data and software are available at the NIH-funded repository SIMTK (https://simtk.org/projects/deepcell). The authors have declared that no competing interests exist.

Attached Files

Published - journal.pcbi.1005177.PDF

Supplemental Material - journal.pcbi.1005177.s001.DOCX

Supplemental Material - journal.pcbi.1005177.s002.TIF

Supplemental Material - journal.pcbi.1005177.s003.TIF

Supplemental Material - journal.pcbi.1005177.s004.TIF

Supplemental Material - journal.pcbi.1005177.s005.TIF

Supplemental Material - journal.pcbi.1005177.s006.TIF

Supplemental Material - journal.pcbi.1005177.s007.TIF

Supplemental Material - journal.pcbi.1005177.s008.TIF

Supplemental Material - journal.pcbi.1005177.s009.TIF

Supplemental Material - journal.pcbi.1005177.s010.TIF

Supplemental Material - journal.pcbi.1005177.s011.TIF

Supplemental Material - journal.pcbi.1005177.s012.TIF

Supplemental Material - journal.pcbi.1005177.s013.TIF

Supplemental Material - journal.pcbi.1005177.s014.TIF

Supplemental Material - journal.pcbi.1005177.s015.TIF

Supplemental Material - journal.pcbi.1005177.s016.TIF

Supplemental Material - journal.pcbi.1005177.s017.TIF

Supplemental Material - journal.pcbi.1005177.s018.TIF

Supplemental Material - journal.pcbi.1005177.s019.AVI

Supplemental Material - journal.pcbi.1005177.s020.AVI

Supplemental Material - journal.pcbi.1005177.s021.AVI

Supplemental Material - journal.pcbi.1005177.s022.AVI

Supplemental Material - journal.pcbi.1005177.s023.AVI

Supplemental Material - journal.pcbi.1005177.s024.AVI

Supplemental Material - journal.pcbi.1005177.s025.AVI

Files

journal.pcbi.1005177.PDF
Files (100.5 MB)
Name Size Download all
md5:58a0b5556d7521a5b68f95edc6cd4969
2.6 MB Preview Download
md5:cea4fdc983adee5bb42be2851f4aba57
8.5 MB Preview Download
md5:ae90f1852db0f5257abea89c694f215e
1.5 MB Preview Download
md5:c25b2b573de5a40c81c6b01ca5141e12
4.7 MB Preview Download
md5:761b13cf4e0e52db2fd8680a289e3e41
425.2 kB Preview Download
md5:7603d0259871c4f5e19b4e52ef766a52
12.3 MB Preview Download
md5:cd53cdc03591a60293a098aebc793805
373.3 kB Preview Download
md5:156d42b476590712dd6147c64f823ae4
3.1 MB Preview Download
md5:14a4510a1d8cca0ec26063f7da80ec6d
913.5 kB Preview Download
md5:fb82b5e8e5c9605a3772530f8b4f5f85
4.3 MB Preview Download
md5:72cc1441579ffc92c5fb085c10c87595
3.1 MB Preview Download
md5:f3215ac66373463ced7e5a2233f933de
2.4 MB Download
md5:8ba38455cfd219d3f939b55ef41397be
3.4 MB Preview Download
md5:6e6077b038958c43c29a22f2c7a748e0
11.5 MB Download
md5:4f32ce2879ff00442d233cf14ea31f66
30.2 kB Download
md5:a2cf27f45dd9c4a75a0fbbb9adc4b4d1
652.8 kB Preview Download
md5:fca8e60ca93085b22a36d1d480e4728d
851.3 kB Preview Download
md5:94b4d7e26263dffdac122c8c47a0dc6b
3.9 MB Download
md5:3bfc600ab74a89650a6e5c4730a008af
4.5 MB Download
md5:c9f61cd85e17ca23949d4d699810ac26
6.4 MB Download
md5:0db454dfd6a92276e0972bd477c18483
2.3 MB Preview Download
md5:c175f930fae0e071907d3c934274cf3a
4.4 MB Preview Download
md5:337c07a153d2f62d71234a663228500a
3.4 MB Preview Download
md5:97f0a84f3342a8b8d5d956b05021f14b
11.0 MB Preview Download
md5:f7e89280f9aa5f38d7999630e32aabf4
1.5 MB Download
md5:65e6f686ecfd59af0ebabbb73c5c7503
2.6 MB Download

Additional details

Created:
August 20, 2023
Modified:
October 18, 2023