Copyright and Licensing
Articles accepted for publication will be licensed under the Creative Commons BY-NC-SA. Authors must sign a non-exclusive distribution agreement after article acceptance.
Reducing the amount of annotated data required to train predictive models is one of the main challenges in applying artificial intelligence to histopathology.
In this paper, we propose a method to enhance the performance of deep learning models trained with limited data in the field of digital pathology. The method relies on a two-stage transfer learning process, where an intermediate model serves as a bridge between a pre-trained model on ImageNet and the final cancer classification model. The intermediate model is fine-tuned with a dataset of over 4,000,000 images weakly labeled with clinical data extracted from TCGA program. The model obtained through the proposed method significantly outperforms a model trained with a traditional transfer learning process.
R. Colling, H. Pitman, K. Oien, N. Rajpoot, P. Macklin, C.-P. A. in Histopathology Working Group, V. Bachtiar, R. Booth, A. Bryant, J. Bull, et al., “Artificial intelligence in digital pathology: a roadmap to routine use in clinical practice,” The Journal of pathology, vol. 249,no. 2, pp. 143–150, 2019. DOI: https://doi.org/10.1002/path.5310
B. Acs, M. Rantalainen, and J. Hartman, “Artificial intelligence as the next step towards precision pathology,” Journal of internal medicine, vol. 288, no. 1, pp. 62–81, 2020. DOI: https://doi.org/10.1111/joim.13030
J. Van der Laak, G. Litjens, and F. Ciompi, “Deep learning in histopathology: the path to the clinic,” Nature medicine, vol. 27, no. 5, pp. 775–784, 2021. DOI: https://doi.org/10.1038/s41591-021-01343-4
H. Yoshida and T. Kiyuna, “Requirements for implementation of artificial intelligence in the practice of gastrointestinal pathology,” World journal of gastroenterology, vol. 27, no. 21, p. 2818, 2021. DOI: https://doi.org/10.3748/wjg.v27.i21.2818
S. Kobayashi, J. H. Saltz, and V. W. Yang, “State of machine and deep learning in histopathological applications in digestive diseases,” World Journal of Gastroenterology, vol. 27, no. 20, p. 2545, 2021. DOI: https://doi.org/10.3748/wjg.v27.i20.2545
A. Reinke, M. D. Tizabi, C. H. Sudre, M. Eisenmann, T. Rädsch, M. Baumgartner, L. Acion, M. Antonelli, T. Arbel, S. Bakas, et al., “Common limitations of image processing metrics: A picture story,” arXiv preprint arXiv:2104.05642, 2021.
L. Pantanowitz, A. Sharma, A. B. Carter, T. Kurc, A. Sussman, and J. Saltz, “Twenty years of digital pathology: an overview of the road travelled, what is on the horizon, and the emergence of vendor-neutral archives,” Journal of pathology informatics, vol. 9, no. 1, p. 40, 2018. DOI: https://doi.org/10.4103/jpi.jpi_69_18
S. J. Pan and Q. Yang, “A survey on transfer learning,” IEEE Transactions on knowledge and data engineering, vol. 22, no. 10, pp. 1345–1359, 2010. DOI: https://doi.org/10.1109/TKDE.2009.191
C. Tan, F. Sun, T. Kong, W. Zhang, C. Yang, and C. Liu, “A survey on deep transfer learning,” in Artificial Neural Networks and Machine Learning–ICANN 2018: 27th International Conference on Artificial Neural Networks, Rhodes, Greece, October 4-7, 2018, Proceedings, Part III 27, pp. 270–279, Springer, 2018. DOI: https://doi.org/10.1007/978-3-030-01424-7_27
J. Phang, T. Févry, and S. R. Bowman, “Sentence encoders on stilts: Supplementary training on intermediate labeled-data tasks,” arXiv preprint arXiv:1811.01088, 2018.
S. Niu, M. Liu, Y. Liu, J. Wang, and H. Song, “Distant domain transfer learning for medical imaging,” IEEE Journal of Biomedical and Health Informatics, vol. 25, no. 10, pp. 3784–3793, 2021. DOI: https://doi.org/10.1109/JBHI.2021.3051470
B. Tan, Y. Song, E. Zhong, and Q. Yang, “Transitive transfer learning,” in Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1155–1164, 2015. DOI: https://doi.org/10.1145/2783258.2783295
D. Komura and S. Ishikawa, “Histology images from uniform tumor regions in TCGA Whole Slide Images,” Jan. 2021.
D. Komura, A. Kawabe, K. Fukuta, K. Sano, T. Umezaki, H. Koda, R. Suzuki, K. Tominaga, M. Ochi, H. Konishi, et al., “Universal encoding of pan-cancer histology by deep texture representations,” Cell Reports, vol. 38, no. 9, p. 110424, 2022. DOI: https://doi.org/10.1016/j.celrep.2022.110424
M. Mittelbronn, A.-C. Hau, S.-Y. Kim, P. V. Nazarov, V. Despotovic, A. Kakoichankava, F. B. K. Borgmann, and G. G. Klamminger, “DeepHisto: Dataset for glioma subtype classification from Whole Slide Images,” May 2023.
M. A. Garcia, M. N. Gramatica, J. P. Ricapito, T. S. Fiezzi, M. Ángel Gignone, and L. Rostagno, “Pathonet,” July 2023.
Copyright (c) 2023 Mario Alejandro García, Martín Nicolás Gramática, Juan Pablo Ricapito
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Articles accepted for publication will be licensed under the Creative Commons BY-NC-SA. Authors must sign a non-exclusive distribution agreement after article acceptance.
Review Stats:
Mean Time to First Response: 89 days
Mean Time to Acceptance Response: 114 days
Member of:
ISSN
1666-6038 (Online)
1666-6046 (Print)