Skip to main content

The application of convolutional neural network to stem cell biology


Induced pluripotent stem cells (iPSC) are one the most prominent innovations of medical research in the last few decades. iPSCs can be easily generated from human somatic cells and have several potential uses in regenerative medicine, disease modeling, drug screening, and precision medicine. However, further innovation is still required to realize their full potential. Machine learning is an algorithm that learns from large datasets for pattern formation and classification. Deep learning, a form of machine learning, uses a multilayered neural network that mimics human neural circuit structure. Deep neural networks can automatically extract features from an image, although classical machine learning methods still require feature extraction by a human expert. Deep learning technology has developed recently; in particular, the accuracy of an image classification task by using a convolutional neural network (CNN) has exceeded that of humans since 2015. CNN is now used to address several tasks including medical issues. We believe that CNN would also have a great impact on the research of stem cell biology. iPSCs are utilized after their differentiation to specific cells, which are characterized by molecular techniques such as immunostaining or lineage tracing. Each cell shows a characteristic morphology; thus, a morphology-based identification system of cell type by CNN would be an alternative technique. The development of CNN enables the automation of identifying cell types from phase contrast microscope images without molecular labeling, which will be applied to several researches and medical science. Image classification is a strong field among deep learning tasks, and several medical tasks will be solved by deep learning-based programs in the future.


Induced pluripotent stem cells (iPSCs) can be established from somatic cells by gene transfer with defined factors [1, 2]. Development of iPSCs has focused on their use as resources for regenerative medicine [3,4,5], drug screening [6, 7], disease modeling [8,9,10,11,12], and precision medicine [13]. However, their full potential has yet to be realized. Artificial intelligence (AI) has had a significant impact as an innovative technology. Among the several types of AI, machine learning is an algorithm for learning pattern formation and classification from large datasets. Deep learning, a form of machine learning, learns data features using a multilayered neural network that mimics human neural circuit structure. A deep neural network can extract the features of an image automatically, although classical machine learning methods require feature extraction by a human expert. Over the past few years, image recognition systems based on convolutional neural network (CNN) have improved dramatically [14,15,16,17,18]. The accuracy of image classification by a CNN has exceeded that of humans. We believe that CNN would also have a great impact on the research of stem cell biology.

iPSCs have multipotency and can differentiate into numerous types of cells. To use these cells for any purposes, the cell type must be characterized by specific molecular techniques, such as immunostaining with specific antibodies or lineage tracing. Each cell type shows a distinct characteristic morphology based on cell type-specific gene expression. Although we cannot identify cell type-specific morphology by microscopic observation alone, a morphology-based identification system by CNN could be an alternative to molecular techniques to identify the cell types. The development of CNN enables the automation of identifying cell types from phase contrast microscope images without molecular labeling. This method could be applied in many ways in research and medicine. In this review, we introduce the development of deep learning technology for stem cell biology and discuss its future direction.

Main text

Development of deep learning technology

Conceptual and technological development of AI began in the 1950s. AI is designed to imitate human thinking ability; to achieve this, many technologies have been developed. Machine learning technology has played a central role in AI since the 1990s [19,20,21,22]. Machine learning is an algorithm for pattern formation and classification without explicit instruction and can establish the learning of rules and statistical structures from big data [23, 24]. Deep learning, a type of machine learning, learns data features using a multilayer neural network that mimics human neural circuit structure [25]. The first breakthrough in neural networks was the concept of the simple perceptron, a single layer feed-forward neural network developed in the 1940s [26, 27]. Each neuron, an architectural component of the neural network, receives signals from upstream neurons. Each received signal has its own weight, the signals are assembled, and the output signals are calculated by activation function (Fig. 1a). The neural network consists of multiple layers of neurons and converts input signal to the final output signal, called the predictive value. The predictive value is compared with the objective value, and error is calculated by loss function. Each neuron signal weight is adjusted to minimize the error by an optimizer method, based on the backward propagation method (Fig. 1b). The backward propagation method was developed in the 1980s and has significantly contributed to the development of the neural network. It was a second breakthrough that allows rapid calculation of the optimal neuron signal [28]. A third breakthrough in 2006 was the development of an algorithm that enables efficient learning in a multilayered neural network without overfitting [29,30,31] and the development of a calculator that includes a Graphics Processing Unit. Deep learning won the ImageNet Large Scale Visual Recognition Challenge (ILSVRC), which is a competition for the most accurate machine learning that classifies multicategory objects [15]. At the 2012 ILSVRC, the convolutional neural network (CNN), a type of deep neural network, showed significant progress in accuracy. Since then, CNN has become a standard method in image classification tasks using machine learning. Indeed, CNN-based deep learning algorithms have won the ILSVRC every year since 2012 [14,15,16, 18]; importantly, accuracy of classification has exceeded that of humans since 2015 [14]. One of the most important characteristics of deep learning is the ability to extract image features automatically [25], although older machine learning techniques require independent feature extraction. Thus, datasets with data labels are required for deep learning. In comparison with other machine learning techniques, deep learning is straightforward and achieves high levels of accuracy. Image recognition by CNN is a powerful tool and is currently applied in many diverse fields.

Fig. 1

a Structure of simple perceptron. x1, x2, x3xi represent the output signals of each upstream neuron and each signal is multiplied by each weight: w1, w2, w3wi. Multiplied signals, which comprise the input signal, are summed and calculated by activation function. y is the output of the perceptron. b Neural network consisting of multiple layers of perceptrons converts input signal to final output signal, which is called the predictive value. Predictive value is compared with the objective value, and error is calculated by loss function. Each neuron signal weight is adjusted to minimize the error with the optimizer method, which is based on the backward propagation method

Convolutional neural network for clinical medicine

Currently, medical science is encumbered with big data, including that of large clinical studies, genomic analyses, and various type of imaging. In the clinical setting, physicians should be able to efficiently analyze laboratory data and imaging in order to determine the appropriate therapeutic strategy. Laboratory data can be analyzed in an objective manner, but image data are often subjectively analyzed. Image recognition tasks in medical science play an important role in image classification and disease diagnosis. The challenge for AI in clinical medicine is to develop a program that has the ability to judge medical conditions as accurately as a physician. Analysis of medical images is a heavy burden for clinicians; therefore, such programs would support their tasks. If the accuracy of image classification and recognition by a deep neural network can approach that of a human for a particular task, it is expected that many medical images could be diagnosed with the same accuracy as clinical specialists.

Skin cancer is often diagnosed visually by a dermatologist; however, it is difficult for a non-specialist to make a diagnosis based on visual appearance only. By using a large dataset of images of labeled tissues, a deep neural network can classify skin cancer with almost the same accuracy as a dermatologist [32]. In the USA, over 20,000 patients lose their eyesight due to diabetic retinopathy. Early detection of retinopathy by an ophthalmologist using images of the eyeground is important for successful treatment. A deep learning algorithm also allows diagnosis of retinopathy with > 90% sensitivity [33, 34]. In April 2018, the US Food and Drug Administration granted marketing authorization for a test device that enables diagnosis of diabetic retinopathy without a clinical physician [35].

Microscopic observations of hematoxylin-eosin-stained sections by a pathologist are most important for a definitive diagnosis of cancer [36]. CNN shows the same power as a pathologist and, as a support tool, is expected to markedly decrease their workload [37, 38]. Radiographic [39,40,41], electrocardiographic [42, 43], and echographic [44, 45] images can also be classified accurately by deep learning. It is likely that deep learning-based automated systems will aid clinicians in the diagnosis of many diseases in the near future.

Convolutional neural network for cell biology

In addition to medical science, deep learning is also used for big data analyses in the field of molecular biology. Microscopic observation of cultured cells is important in cell biology. Specific cell types or conditions are recognized by fluorescently labeled antibodies. Each cell shows a characteristic gene expression pattern, including for structural proteins specific to the cell type and state; therefore, each cell type has unique morphological features. Although humans cannot identify differentiated cells visually, machine learning can (Fig. 2).

Fig. 2

Concept of a morphology-based cell identification system. Each cell shows a unique morphology. The machine can identify the cell type solely from phase contrast images, which humans cannot do

Christiansen et al. developed a label-free cell recognition system termed in silico labeling [46], which allows identification of nuclei, cell type, and cell state from bright field microscopy images without immunolabeling. Hematopoietic stem cells have multipotency and can differentiate into all types of blood cell lineages. The deep learning method can identify the final hematopoietic lineage of differentiated cells from microscope images with high accuracy [47]. iPSC [48] and C2C12 [49] cells can also be recognized by CNN. The semantic segmentation method, which is based on CNN, allows classification of images at the pixel level by assigning each pixel in the image to an object class. It enables the detection of object boundaries and classifies images within the boundary area. It is best known for its use in driverless car technology [50]. Semantic segmentation is also used in cell biology and medical science. U-Net is one of the most common networks used for segmentation and is optimized for biological and medical imaging [51]. Semantic segmentation enables identification of both cell location and classification. The deep learning method can be applied not only to microscope images, but also to genomic and RNA sequencing. The DeepBind system can predict the binding motifs for transcription factors in DNA and RNA from ChIP-seq data [52]. In ghost cytometry, which is cell sorting without molecular labels, morphological features are converted to wave data using a random barcode system to classify and sort cells [53]. A machine learning algorithm can also be used to classify cell morphology [54, 55], cardiac tissue contractility, and molecular imaging [56].

Automated recognition of iPSC-derived differentiated cells

iPSC-derived cells show patient-specific cellular physiology; thus, they have several uses in disease analysis, drug screening, and regenerative medicine. Endothelial cells line the inside of blood vessels in vivo and have important roles in organ homeostasis. iPSCs can differentiate into mature endothelial cells [57] and can be applied in disease modeling and organ formation. iPSC-derived endothelial cells (iPSC-ECs) have been used to ameliorate the cellular pathology of Moyamoya disease [58], aortic valve calcification [59], and pulmonary arterial hypertension [11]. The initial step in iPSC research is to identify iPSC-derived cells and check their quality by microscopic observation. Indeed, quality of iPSCs, including differentiation efficiency, differs among several iPSC lines.

We developed an automated recognition system for iPSC-ECs without molecular labeling using deep learning technology [60]. iPSC-ECs can be recognized by a deep learning system with high performance, with F1 score > 0.75 and accuracy > 0.9. First, we prepared input datasets for learning. To develop an image classification system, it is important to prepare a large number of high-quality datasets. Although the development of an algorithm allows us to use a reduced number of datasets, over 10,000 images are necessary for accurate learning [33, 60, 61]. To avoid overfitting, it is indispensable to obtain plural differentiation induction data from the study of iPSCs. The strategy for identification of iPSC-ECs is shown in Fig. 3. CNN was used to predict whether target blocks were endothelial cells or non-endothelial cells from the input dataset, based on random phase contrast images. Immunostaining for CD31 was used and the results were compared with the CNN prediction, and weights of the neural network were optimized by the back-propagation method. Although hyperparameters affect the efficiency of learning, dataset preparation such as input data size, threshold of answer (endothelial cells/non-endothelial cells), and network types is highly important to increase the accuracy of prediction. The depth and complexity of the neural network also affects the prediction accuracy [14, 16,17,18]. Morphology-based identification systems by deep learning have a significant advantage in the practical use of iPSCs, as they are easy to use and highly versatile.

Fig. 3

Strategy to identify iPSC-ECs by a deep neural network. iPSCs are differentiated to endothelial cells, and phase contrast microscope images are captured. Input blocks are cropped from phase contrast images and inputted into the neural network. The neural network predicts whether target blocks are “unstained” or “stained.” Target blocks that include the target cells to be examined are cropped from binary images of CD31-immunostaining to generate correct answers, which are determined by the white pixel ratio of target blocks. Predictions are compared with the correct answers, and weights of the network are adjusted automatically to increase the predictive value of the deep neural network

Future direction of deep learning in clinical medicine and biology

The development of image classification tasks is promising for the replacement of human expertise by automated systems in the near future. Moreover, automated systems will be able to perform the tasks that humans cannot, because their ability in image classification and recognition for a particular job has exceeded that of humans since 2015 [14]. Furthermore, an automated system can recognize iPSC-ECs in microscope images, which a human expert cannot do. Deep learning can handle various types of datasets [25], such as sound, natural language, and time-series data. Natural language processing is also a field that has developed rapidly through deep learning [62, 63]. The processing ability of natural language is now inferior to that of humans. When this ability is applied to literature searching, writing preparation, and conversation, deep learning in natural language processing will be applicable to science and clinical medicine. Reinforcement learning has also significantly developed in recent years [64]. AlphaGo Zero, which is based on a reinforcement learning algorithm, was able to compete with overwhelming success against the world’s top players of Go by learning in only 3 days [65]. The fact that a machine could exceed human ability by self-learning without being taught by humans was extraordinary. In the concept of self-learning, reward is involved in the algorithm of reinforcement learning, and reinforcement learning is performed with problem setting that maximizes reward. Reinforcement learning is likely to have a significant bearing in the medical and biological fields in the future [66]. However, although it is anticipated that AI will exceed humans in many tasks, there are obvious limitations. The real world is much more complicated than previously thought. Even in situations that humans have never encountered before, they can make inferences and change their actions accordingly. In machine learning, it is difficult to deal with unexpected problems. In the future, we predict that complicated problems will be solved with AI, providing correct conclusions using less human labor, in less time, and with high accuracy.


The accuracy of image recognition has been dramatically improved by deep learning technology. Several medical issues may be addressed by automated systems based on deep learning. For cell biology, deep learning-based image recognition systems may replace molecular techniques such as immunostaining. Indeed, the detection of iPSC-ECs from microscope images without molecular labeling with high accuracy will significantly enhance the study of iPSCs.

Availability of data and materials

Not applicable.



Artificial intelligence


Convolutional neural network


ImageNet Large Scale Visual Recognition Challenge


Induced pluripotent stem cell-derived endothelial cells


Induced pluripotent stem cells


  1. 1.

    Takahashi K, Tanabe K, Ohnuki M, Narita M, Ichisaka T, Tomoda K, et al. Induction of pluripotent stem cells from adult human fibroblasts by defined factors. Cell. 2007;131(5):861–72.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  2. 2.

    Takahashi K, Yamanaka S. Induction of pluripotent stem cells from mouse embryonic and adult fibroblast cultures by defined factors. Cell. 2006;126(4):663–76.

    CAS  PubMed  Article  Google Scholar 

  3. 3.

    Nagoshi N, Okano H. Applications of induced pluripotent stem cell technologies in spinal cord injury. J Neurochem. 2017;141(6):848–60.

    CAS  PubMed  Article  Google Scholar 

  4. 4.

    Yuasa S, Fukuda K. Recent advances in cardiovascular regenerative medicine: the induced pluripotent stem cell era. Expert Rev Cardiovasc Ther. 2008;6(6):803–10.

    CAS  PubMed  Article  Google Scholar 

  5. 5.

    Yuasa S, Fukuda K. Cardiac regenerative medicine. Circulation. 2008;72(Supplement A):A49–55.

    Article  Google Scholar 

  6. 6.

    Avior Y, Sagi I, Benvenisty N. Pluripotent stem cells in disease modelling and drug discovery. Nat Rev Mol Cell Biol. 2016;17(3):170–82.

    CAS  PubMed  Article  Google Scholar 

  7. 7.

    Ebert AD, Liang P, Wu JC. Induced pluripotent stem cells as a disease modeling and drug screening platform. J Cardiovasc Pharmacol. 2012;60(4):408–16.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  8. 8.

    Moretti A, Bellin M, Welling A, Jung CB, Lam JT, Bott-Flugel L, et al. Patient-specific induced pluripotent stem-cell models for long-QT syndrome. N Engl J Med. 2010;363(15):1397–409.

    CAS  PubMed  Article  Google Scholar 

  9. 9.

    Shimojima M, Yuasa S, Motoda C, Yozu G, Nagai T, Ito S, et al. Emerin plays a crucial role in nuclear invagination and in the nuclear calcium transient. Sci Rep. 2017;7:44312.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  10. 10.

    Tanaka A, Yuasa S, Mearini G, Egashira T, Seki T, Kodaira M, et al. Endothelin-1 induces myofibrillar disarray and contractile vector variability in hypertrophic cardiomyopathy-induced pluripotent stem cell-derived cardiomyocytes. J Am Heart Assoc. 2014;3(6):e001263.

    PubMed  PubMed Central  Article  CAS  Google Scholar 

  11. 11.

    Gu M, Shao NY, Sa S, Li D, Termglinchan V, Ameen M, et al. Patient-specific iPSC-derived endothelial cells uncover pathways that protect against pulmonary hypertension in BMPR2 mutation carriers. Cell Stem Cell. 2017;20(4):490–504.e5.

    CAS  PubMed  Article  Google Scholar 

  12. 12.

    Tanaka A, Yuasa S, Node K, Fukuda K. Cardiovascular disease modeling using patient-specific induced pluripotent stem cells. Int J Mol Sci. 2015;16(8):18894–922.

    PubMed  PubMed Central  Article  Google Scholar 

  13. 13.

    Chen IY, Matsa E, Wu JC. Induced pluripotent stem cells: at the heart of cardiovascular precision medicine. Nat Rev Cardiol. 2016;13(6):333–49.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  14. 14.

    He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. ArXiv e-prints, vol. 1512; 2015.

    Google Scholar 

  15. 15.

    Krizhevsky A, Sutskever I, Hinton GE. ImageNet classification with deep convolutional neural networks. In: Proceedings of the 25th International Conference on Neural Information Processing Systems, vol. 2999257. Lake Tahoe, Nevada: Curran Associates Inc; 2012. p. 1097–105.

    Google Scholar 

  16. 16.

    Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, et al. Going deeper with convolutions: ArXiv e-prints; 2014. p. 1409.

  17. 17.

    Zeiler MD, Fergus R. Visualizing and understanding convolutional networks. In: Fleet D, Pajdla T, Schiele B, Tuytelaars T, editors. Computer Vision – ECCV 2014: 13th European Conference, Zurich, Switzerland, September 6-12, 2014, Proceedings, Part I. Cham: Springer International Publishing; 2014. p. 818–33.

    Google Scholar 

  18. 18.

    Zeng X, Ouyang W, Yan J, Li H, Xiao T, Wang K, et al. Crafting GBD-Net for object detection. ArXiv e-prints, vol. 1610; 2016.

    Google Scholar 

  19. 19.

    Mor-Yosef S, Samueloff A, Modan B, Navot D, Schenker JG. Ranking the risk factors for cesarean: logistic regression analysis of a nationwide study. Obstet Gynecol. 1990;75(6):944–7.

    CAS  PubMed  Google Scholar 

  20. 20.

    Gorodeski EZ, Ishwaran H, Kogalur UB, Blackstone EH, Hsich E, Zhang ZM, et al. Use of hundreds of electrocardiographic biomarkers for prediction of mortality in postmenopausal women: the Women’s Health Initiative. Circ Cardiovasc Qual Outcomes. 2011;4(5):521–32.

    PubMed  PubMed Central  Article  Google Scholar 

  21. 21.

    Heylman C, Datta R, Sobrino A, George S, Gratton E. Supervised machine learning for classification of the electrophysiological effects of chronotropic drugs on human induced pluripotent stem cell-derived cardiomyocytes. PLoS One. 2015;10(12):e0144572.

    PubMed  PubMed Central  Article  CAS  Google Scholar 

  22. 22.

    Hsich E, Gorodeski EZ, Blackstone EH, Ishwaran H, Lauer MS. Identifying important risk factors for survival in patient with systolic heart failure using random survival forests. Circ Cardiovasc Qual Outcomes. 2011;4(1):39–45.

    PubMed  Article  Google Scholar 

  23. 23.

    Cortes C, Vapnik V. Support-vector networks. Mach Learn. 1995;20(3):273–97.

    Google Scholar 

  24. 24.

    Quinlan JR. Induction of decision trees. Mach Learn. 1986;1(1):81–106.

    Google Scholar 

  25. 25.

    Lecun Y, Bengio Y, Hinton G. Deep learning. Nature. 2015;521(7553):436–44.

    CAS  PubMed  Article  Google Scholar 

  26. 26.

    McCulloch WS, Pitts W. A logical calculus of the ideas immanent in nervous activity. Bull Math Biophys. 1943;5(4):115–33.

    Article  Google Scholar 

  27. 27.

    Rosenblatt F. The perceptron: a probabilistic model for information storage and organization in the brain. Psychol Rev. 1958;65(6):386–408.

    CAS  PubMed  Article  Google Scholar 

  28. 28.

    Rumelhart DE, Hinton GE, Williams RJ. Learning representations by back-propagating errors. Nature. 1986;323:533.

    Article  Google Scholar 

  29. 29.

    Bengio Y, Lamblin P, Popovici D, Larochelle H. Greedy layer-wise training of deep networks. In: Proceedings of the 19th International Conference on Neural Information Processing Systems, vol. 2976476. Canada: MIT Press; 2006. p. 153–60.

    Google Scholar 

  30. 30.

    Hinton GE, Osindero S, Teh YW. A fast learning algorithm for deep belief nets. Neural Comput. 2006;18(7):1527–54.

    PubMed  Article  Google Scholar 

  31. 31.

    Ranzato MA, Poultney C, Chopra S, LeCun Y. Efficient learning of sparse representations with an energy-based model. In: Proceedings of the 19th International Conference on Neural Information Processing Systems, vol. 2976599. Canada: MIT Press; 2006. p. 1137–44.

    Google Scholar 

  32. 32.

    Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature. 2017;542(7639):115–8.

    CAS  Article  PubMed  Google Scholar 

  33. 33.

    Gulshan V, Peng L, Coram M, Stumpe MC, Wu D, Narayanaswamy A, et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA. 2016;316(22):2402–10.

    Article  PubMed  Google Scholar 

  34. 34.

    Ting DSW, Cheung CY, Lim G, Tan GSW, Quang ND, Gan A, et al. Development and validation of a deep learning system for diabetic retinopathy and related eye diseases using retinal images from multiethnic populations with diabetes. JAMA. 2017;318(22):2211–23.

    PubMed  PubMed Central  Article  Google Scholar 

  35. 35.

    Abràmoff MD, Lavin PT, Birch M, Shah N, Folk JC. Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care offices. Npj Digit Med. 2018;1(1):39.

    Article  PubMed  PubMed Central  Google Scholar 

  36. 36.

    Komura D, Ishikawa S. Machine learning methods for histopathological image analysis. Comput Struct Biotechnol J. 2018;16:34–42.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  37. 37.

    Ehteshami Bejnordi B, Veta M, Johannes van Diest P, van Ginneken B, Karssemeijer N, Litjens G, et al. Diagnostic assessment of deep learning algorithms for detection of lymph node metastases in women with breast cancer. JAMA. 2017;318(22):2199–210.

    PubMed  PubMed Central  Article  Google Scholar 

  38. 38.

    Litjens G, Sanchez CI, Timofeeva N, Hermsen M, Nagtegaal I, Kovacs I, et al. Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis. Sci Rep. 2016;6:26286.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  39. 39.

    Liu F, Jang H, Kijowski R, Bradshaw T, McMillan AB. Deep learning MR imaging-based attenuation correction for PET/MR imaging. Radiology. 2018;286(2):676–84.

    PubMed  Article  Google Scholar 

  40. 40.

    Teramoto A, Fujita H, Yamamuro O, Tamaki T. Automated detection of pulmonary nodules in PET/CT images: ensemble false-positive reduction using a convolutional neural network technique. Med Phys. 2016;43(6):2821–7.

    PubMed  Article  Google Scholar 

  41. 41.

    Yasaka K, Akai H, Abe O, Kiryu S. Deep learning with convolutional neural network for differentiation of liver masses at dynamic contrast-enhanced CT: a preliminary study. Radiology. 2018;286(3):887–96.

    PubMed  Article  Google Scholar 

  42. 42.

    Acharya UR, Oh SL, Hagiwara Y, Tan JH, Adam M, Gertych A, et al. A deep convolutional neural network model to classify heartbeats. Comput Biol Med. 2017;89:389–96.

    PubMed  Article  Google Scholar 

  43. 43.

    Rajkomar A, Oren E, Chen K, Dai AM, Hajaj N, Hardt M, et al. Scalable and accurate deep learning with electronic health records. Npj Digit Med. 2018;1(1):18.

    Article  PubMed  PubMed Central  Google Scholar 

  44. 44.

    Gandhi S, Mosleh W, Shen J, Chow CM. Automation, machine learning, and artificial intelligence in echocardiography: a brave new world. Echocardiography. 2018;35(9):1402–18.

    PubMed  Article  Google Scholar 

  45. 45.

    Han S, Kang HK, Jeong JY, Park MH, Kim W, Bang WC, et al. A deep learning framework for supporting the classification of breast lesions in ultrasound images. Phys Med Biol. 2017;62(19):7714–28.

    PubMed  Article  Google Scholar 

  46. 46.

    Christiansen EM, Yang SJ, Ando DM, Javaherian A, Skibinski G, Lipnick S, et al. In silico labeling: predicting fluorescent labels in unlabeled images. Cell. 2018;173(3):792–803.e19.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  47. 47.

    Buggenthin F, Buettner F, Hoppe PS, Endele M, Kroiss M, Strasser M, et al. Prospective identification of hematopoietic lineage choice by deep learning. Nat Methods. 2017;14(4):403–6.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  48. 48.

    Yuan-Hsiang C, Abe K, Yokota H, Sudo K, Nakamura Y, Cheng-Yu L, et al. Human induced pluripotent stem cell region recognition in microscopy images using Convolutional Neural Networks. In: Conference proceedings : Annual International Conference of the IEEE Engineering in Medicine and Biology Society IEEE Engineering in Medicine and Biology Society Annual Conference, vol. 2017; 2017. p. 4058–61.

    Google Scholar 

  49. 49.

    Niioka H, Asatani S, Yoshimura A, Ohigashi H, Tagawa S, Miyake J. Classification of C2C12 cells at differentiation by convolutional neural network of deep learning using phase contrast images. Hum Cell. 2018;31(1):87–93.

    CAS  PubMed  Article  Google Scholar 

  50. 50.

    Badrinarayanan V, Kendall A, Cipolla R. SegNet: a deep convolutional encoder-decoder architecture for image segmentation: ArXiv e-prints; 2015.

  51. 51.

    Ronneberger O, Fischer P, Brox T. U-Net: convolutional networks for biomedical image segmentation: ArXiv e-prints; 2015.

  52. 52.

    Alipanahi B, Delong A, Weirauch MT, Frey BJ. Predicting the sequence specificities of DNA- and RNA-binding proteins by deep learning. Nat Biotechnol. 2015;33:831.

    CAS  PubMed  Article  Google Scholar 

  53. 53.

    Ota S, Horisaki R, Kawamura Y, Ugawa M, Sato I, Hashimoto K, et al. Ghost cytometry. Science. 2018;360(6394):1246–51.

    CAS  PubMed  Article  Google Scholar 

  54. 54.

    Fan K, Zhang S, Zhang Y, Lu J, Holcombe M, Zhang X. A machine learning assisted, label-free, non-invasive approach for somatic reprogramming in induced pluripotent stem cell colony formation detection and prediction. Sci Rep. 2017;7(1):13496.

    PubMed  PubMed Central  Article  CAS  Google Scholar 

  55. 55.

    Sommer C, Gerlich DW. Machine learning in cell biology - teaching computers to recognize phenotypes. J Cell Sci. 2013;126(Pt 24):5529–39.

    CAS  PubMed  Article  Google Scholar 

  56. 56.

    Juhola M, Joutsijoki H, Varpa K, Saarikoski J, Rasku J, Iltanen K, et al. On computation of calcium cycling anomalies in cardiomyocytes data. In: Conference proceedings : Annual International Conference of the IEEE Engineering in Medicine and Biology Society IEEE Engineering in Medicine and Biology Society Annual Conference, vol. 2014; 2014. p. 1444–7.

    Google Scholar 

  57. 57.

    Zhang J, Chu LF, Hou Z, Schwartz MP, Hacker T, Vickerman V, et al. Functional characterization of human pluripotent stem cell-derived arterial endothelial cells. Proc Natl Acad Sci U S A. 2017;114(30):E6072–e8.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  58. 58.

    Hamauchi S, Shichinohe H, Uchino H, Yamaguchi S, Nakayama N, Kazumata K, et al. Cellular functions and gene and protein expression profiles in endothelial cells derived from Moyamoya disease-specific iPS cells. PLoS One. 2016;11(9):e0163561.

    PubMed  PubMed Central  Article  CAS  Google Scholar 

  59. 59.

    Theodoris CV, Li M, White MP, Liu L, He D, Pollard KS, et al. Human disease modeling reveals integrated transcriptional and epigenetic mechanisms of NOTCH1 haploinsufficiency. Cell. 2015;160(6):1072–86.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  60. 60.

    Kusumoto D, Lachmann M, Kunihiro T, Yuasa S, Kishino Y, Kimura M, et al. Automated deep learning-based system to identify endothelial cells derived from induced pluripotent stem cells. Stem Cell Rep. 2018;10(6):1687–95.

    CAS  Article  Google Scholar 

  61. 61.

    Shichijo S, Nomura S, Aoyama K, Nishikawa Y, Miura M, Shinagawa T, et al. Application of convolutional neural networks in the diagnosis of Helicobacter pylori infection based on endoscopic images. EBioMedicine. 2017;25:106–11.

    PubMed  PubMed Central  Article  Google Scholar 

  62. 62.

    Chen MC, Ball RL, Yang L, Moradzadeh N, Chapman BE, Larson DB, et al. Deep learning to classify radiology free-text reports. Radiology. 2018;286(3):845–52.

    PubMed  Article  Google Scholar 

  63. 63.

    Mikolov T, Sutskever I, Chen K, Corrado G, Dean J. Distributed representations of words and phrases and their compositionality: ArXiv e-prints; 2013.

  64. 64.

    Mnih V, Kavukcuoglu K, Silver D, Rusu AA, Veness J, Bellemare MG, et al. Human-level control through deep reinforcement learning. Nature. 2015;518:529.

    CAS  PubMed  Article  Google Scholar 

  65. 65.

    Silver D, Schrittwieser J, Simonyan K, Antonoglou I, Huang A, Guez A, et al. Mastering the game of Go without human knowledge. Nature. 2017;550(7676):354–9.

    CAS  Article  PubMed  Google Scholar 

  66. 66.

    Mahmud M, Shamim Kaiser M, Hussain A, Vassanelli S. Applications of deep learning and reinforcement learning to biological data: ArXiv e-prints; 2017.

Download references


We thank all our laboratory members for their assistance.


This research was supported by AMED under Grant Number JP18bm0404026.

Author information




DK and SY wrote the manuscript. Both authors read and approved the final manuscript.

Corresponding author

Correspondence to Shinsuke Yuasa.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

SY owns equity in Heartseed, Inc.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Kusumoto, D., Yuasa, S. The application of convolutional neural network to stem cell biology. Inflamm Regener 39, 14 (2019).

Download citation


  • Induced pluripotent stem cell
  • Deep learning
  • Machine learning
  • Artificial intelligence
  • Endothelial cell
  • Stem cell
  • Image recognition