Generation of PAS-stained images of glomerular tissue units using a generative adversarial network with spectral normalization colorization method

Jincheng Peng, Guoyue Chen, Kazuki Saruta, Yuki Terata

Article ID: 4085
Vol 6, Issue 2, 2023

VIEWS - 3969 (Abstract) 1792 (PDF)

Abstract


In recent years, the pathological diagnosis of glomerular diseases typically involves the study of glomerular his-to pathology by specialized pathologists, who analyze tissue sections stained with Periodic Acid-Schiff (PAS) to assess tissue and cellular abnormalities. In recent years, the rapid development of generative adversarial networks composed of generators and discriminators has led to further developments in image colorization tasks. In this paper, we present a generative adversarial network by Spectral Normalization colorization designed for color restoration of grayscale images depicting glomerular cell tissue elements. The network consists of two structures: the generator and the discriminator. The generator incorporates a U-shaped decoder and encoder network to extract feature information from input images, extract features from Lab color space images, and predict color distribution. The discriminator network is responsible for optimizing the generated colorized images by comparing them with real stained images. On the Human Biomolecular Atlas Program (HubMAP)—Hacking the Kidney FTU segmentation challenge dataset, we achieved a peak signal-to-noise ratio of 29.802 dB, along with high structural similarity results as other colorization methods. This colorization method offers an approach to add color to grayscale images of glomerular cell tissue units. It facilitates the observation of physiological information in pathological images by doctors and patients, enabling better pathological-assisted diagnosis of certain kidney diseases.


Keywords


spectral normalization; generative adversarial networks; PAS staining; medical image colorization

Full Text:

PDF


References


1. Schell C, Wanner N, Huber TB. Glomerular development – Shaping the multi-cellular filtration unit. Seminars in Cell & Developmental Biology. 2014; 36: 39-49. doi: 10.1016/j.semcdb.2014.07.016

2. Yang S, Wang J, Chen Y, et al. Concurrent Kidney Glomerular and Interstitial Lesions Associated with Kimura’s Disease. Nephron. 2019; 143(2): 92-99. doi: 10.1159/000501638

3. Iizuka S, Simo-Serra E, Ishikawa H. Let there be color! ACM Transactions on Graphics. 2016; 35(4): 1-11. doi: 10.1145/2897824.2925974

4. Zhang R, Isola P, Efros AA. Colorful image colorization. European conference on computer vision; 2016.

5. Larsson G, Maire M, Shakhnarovich G. Learning representations for automatic colorization. European conference on computer vision; 2016.

6. Nazeri K, Ng E, Ebrahimi M. Image colorization using generative adversarial networks. International Conference on Articulated Motion and Deformable Objects; 2018.

7. Cao Y, Zhou Z, Zhang W, et al. Unsupervised diverse colorization via generative adversarial networks. Joint European conference on machine learning and knowledge discovery in databases; 2017.

8. Miyato T, Kataoka T, Koyama M, et al. Spectral normalization for generative adversarial networks. ArXiv. 2018.

9. Lagodzinski P, Smolka B. Colorization of medical images. Asia-Pacific Signal and Information Processing Association; 2009.

10. Khan TH, Mohammed SK, Imtiaz MS, et al. Efficient Color Reproduction Algorithm for Endoscopic Images Based on Dynamic Color Map. Journal of Medical and Biological Engineering. 2016; 36(2): 226-235. doi: 10.1007/s40846-016-0120-5

11. Liang Y, Lee D, Li Y, et al. Unpaired medical image colorization using generative adversarial network. Multimedia Tools and Applications. 2021; 81(19): 26669-26683. doi: 10.1007/s11042-020-10468-6

12. Chen S, Xiao N, Shi X, et al. ColorMedGAN: A Semantic Colorization Framework for Medical Images. Applied Sciences. 2023; 13(5): 3168. doi: 10.3390/app13053168

13. Ronneberger O, Fischer P, Brox T. U-net: Convolutional networks for biomedical image segmentation. In: Proceedings of the 2015 International Conference on Medical image computing and computer-assisted intervention.

14. Kiani L, Saeed M, Nezamabadi-pour H. Image colorization using generative adversarial networks and transfer learning: International Conference on Machine Vision and Image Processing (MVIP). IEEE; 2020. 1-6.

15. Coyle EJ, Lin JH. Stack filters and the mean absolute error criterion. IEEE Transactions on Acoustics, Speech, and Signal Processing. 1988; 36(8): 1244-1254. doi: 10.1109/29.1653

16. Wang Z, Bovik AC, Sheikh HR, et al. Image Quality Assessment: From Error Visibility to Structural Similarity. IEEE Transactions on Image Processing. 2004; 13(4): 600-612. doi: 10.1109/tip.2003.819861

17. HuBMAP Hacking the Kidney. Available online: http://Kaggle.com/c/hubmap-kidney-segmentation (accessed on 22 October 2023).




DOI: https://doi.org/10.24294/irr.v6i2.4085

Refbacks

  • There are currently no refbacks.


License URL: https://creativecommons.org/licenses/by/4.0/

This site is licensed under a Creative Commons Attribution 4.0 International License.