2D brain MRI image synthesis based on lightweight denoising diffusion probabilistic model
Vol 6, Issue 1, 2023
VIEWS - 328 (Abstract) 217 (PDF)
Abstract
In recent years, brain health has received increasing attention, but conventional acquisition of brain MRI (magnetic resonance imaging) images still suffer from issues such as missing data, artifacts, and high costs, which hinders research and diagnosis. With the application of deep learning in medical image synthesis, low-cost, efficient, and high-quality medical MRI synthesis techniques have become a prominent research focus and have gradually matured. However, traditional methods for synthesizing magnetic resonance imaging (MRI) mostly rely on generative adversarial networks, which require fine-tuning of parameters and learning rates to achieve stringent Nash equilibrium conditions, leading to problems such as gradient explosions and mode collapse. Building upon the latest research in synthetic models DDPM (denoising diffusion probabilistic model), we propose a novel approach for 2D brain MRI image synthesis based on a lightweight denoising diffusion probabilistic model. This method improves the attention module in the denoising diffusion probabilistic model to make it more lightweight. Additionally, we adopt the smooth L1 loss function as a replacement for the traditional mean absolute error (L1 loss) by comparing the error between the 2D brain MRI images with added noise and the real noise for training the model. Finally, we validate the proposed model on the MRI Brain Tumor Classification dataset, demonstrating that it achieves high-quality synthesis results while significantly reducing the parameter count of the DDPM model.
Keywords
Full Text:
PDFReferences
1. Khan P, Kader MF, Islam SMR, et al. Machine learning and deep learning approaches for brain disease diagnosis: Principles and recent advances. IEEE Access 2021; 9: 37622–37655. doi: 10.1109/ACCESS.2021.3062484
2. Bakas S, Akbari H, Sotiras A, et al. Advancing the cancer genome atlas glioma MRI collections with expert segmentation labels and radiomic features. Scientific Data 2017; 4(1): 170117. doi: 10.1038/sdata.2017.117
3. Bahadure NB, Ray AK, Thethi HP. Image analysis for MRI based brain tumor detection and feature extraction using biologically inspired BWT and SVM. International Journal of Biomedical Imaging 2017; 2017: 9749108. doi: 10.1155/2017/9749108
4. Goodfellow IJ, Pouget-Abadie J, Mirza M, et al. Generative adversarial nets. Advances in Neural Information Processing Systems 2014; 3(11): 1–9. doi: 10.1145/3422622
5. Arjovsky M, Chintala S, Bottou L. Wasserstein generative adversarial networks. In: Proceedings of the 34th International Conference on Machine Learning; 6–11 August 2017; Sydney, NSW, Australia. pp. 214–223.
6. Han C, Hayashi H, Rundo L, et al. GAN-based synthetic brain MR image generation. In: Proceedings of the 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018); 4–7 April 2018; Washington, DC, USA. pp. 734–738.
7. Sohl-Dickstein J, Weiss EA, Maheswaranathan N, Ganguli S. Deep unsupervised learning using nonequilibrium thermodynamics. In: Proceedings of the 32th International Conference on Machine Learning; 6–11 July 2015; Lille, France. pp. 2256–2265.
8. Ho J, Jain A, Abbeel P. Denoising diffusion probabilistic models. In: Proceedings of the 34th Conference on Neural Information Processing Systems (NeurIPS 2020); 6–12 December 2020; Vancouver, Canada. pp. 1–12.
9. Song J, Meng C, Ermon S. Denoising diffusion implicit models. In: Proceedings of the Ninth International Conference on Learning Representations (Virtual Only); 3–7 May 2021; Vienna, Austria. pp. 1–20.
10. Chung H, Ye JC. Score-based diffusion models for accelerated MRI. Medical Image Analysis 2022; 80: 102479. doi: 10.1016/j.media.2022.102479
11. Xie Y, Li Q. Measurement-conditioned denoising diffusion probabilistic model for under-sampled medical image reconstruction. In: Wang L, Dou Q, Fletcher PT, et al. (editors). Medical Image Computing and Computer Assisted Intervention—MICCAI 2022. Springer, Cham; 2022. pp. 655–664.
12. Hu J, Shen L, Sun G. Squeeze-and-excitation networks. In: Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition; 18–23 June 2018; Salt Lake City, UT, USA. pp. 7132–7141.
13. Dhariwal P, Nichol A. Diffusion models beat GANs on image synthesis. In: Proceedings of the 35th Conference on Neural Information Processing Systems (NeurIPS 2021); 6–14 December 2021; Canada. pp. 1–15.
14. Ronneberger O, Fischer P, Brox T. U-net: Convolutional networks for biomedical image segmentation. In: Navab N, Hornegger J, Wells W, et al. (editors). Medical Image Computing and Computer-Assisted Intervention—MICCAI 2015. Springer, Cham; 2015. pp. 234–241.
15. Karras T, Aila T, Laine S, Lehtinen J. Progressive growing of GANs for improved quality, stability, and variation. In: Proceedings of the 6th International Conference on Learning Representations (ICLR 2018); 30 April–3 May 2018; Vancouver, BC, Canada. pp. 1–26.
16. Brain tumor classification (MRI). Available online: https://www.kaggle.com/datasets/sartajbhuvaji/brain-tumor-classification-mri (accessed on 26 September 2023).
17. Wang Z, Bovik AC, Sheikh HR, Simoncelli EP. Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing 2004; 13(4): 600–612. doi: 10.1109/TIP.2003.819861
18. Nichol A, Dhariwal P. Improved denoising diffusion probabilistic models. In: Proceedings of the 38th International Conference on Machine Learning; 18–24 July 2021. pp. 8162–8171.
DOI: https://doi.org/10.24294/mipt.v6i1.2518
Refbacks
- There are currently no refbacks.
Copyright (c) 2023 Jincheng Peng, Guoyue Chen, Kazuki Saruta, Yuki Terata
License URL: https://creativecommons.org/licenses/by-nc/4.0/
This site is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.