Cross-Modality Image Translation from Brain PET/CT to FLAIR Image with GAN
- 주제어 (키워드) Deep learning , Magnetic resonance imaging (MRI) , Positron emission tomography (PET) , Generative adversarial network (GAN) , Image to image translation
- 발행기관 서강대학교 일반대학원
- 지도교수 최용
- 발행년도 2022
- 학위수여년월 2022. 8
- 학위명 석사
- 학과 및 전공 일반대학원 전자공학과
- 실제 URI http://www.dcollection.net/handler/sogang/000000067049
- UCI I804:11029-000000067049
- 본문언어 영어
- 저작권 서강대학교 논문은 저작권 보호를 받습니다.
초록
In this study, we proposed a generative adversarial network (GAN) model, called CypixGAN, to synthesize brain FLAIR MR images from PET and/or CT images. CypixGAN architecture was designed by combining CycleGAN framework with L1 loss function of pix2pix. It was a multi-channel GAN model using various data types as an input, such as PET and CT images, PET-only images, or CT-only images. Three loss functions were mixed in training process. One was the adversarial loss calculated when the discriminator tried to distinguish synthesized FLAIR MR images from label FLAIR MR images. Another was the cycle loss calculated when L1 distance was measured between the synthesized PET and/or CT images through the generator and the label PET and/or CT images. The other was the L1 loss, which represented the L1 distance between synthesized FLAIR MR images and label FLAIR MR images. Ninety-eight images were used for training and 45 images were used for testing the trained network. The differences between label FLAIR MR images and synthesized FLAIR MR images generated by CypixGAN, pix2pix, and CycleGAN with three types of inputs were quantitatively analyzed by calculating PSNRs and GMSDs. The synthesized FLAIR MR images were successfully generated by CypixGAN proposed in this study and its quality was better than those by pix2pix and CycleGAN. The quality of synthesized FLAIR MR images generated using PET and CT images was superior to those of PET-only images or CT-only images regardless of the frameworks. Best PSNRs and GMSDs were achieved by CypixGAN with PET and CT images. The quantitative results of CypixGAN, pix2pix, and CycleGAN with PET and CT images were 20.23±1.97, 19.35±1.66, and 19.41±1.81 in PSNR, and 0.18±0.02, 0.21±0.02, and 0.20±0.02 in GMSD. In this study, we demonstrated that high quality FLAIR MR images from the PET and CT images could be synthesized by the CypixGAN. This proved that CypixGAN helps to improve the synthesis performance of the network by learning more feature distributions.
more