Deep Learning for Medical Image Enhancement: A Systematic Review of Architectures, Imaging Modalities, and Open Challenges

SHAHAD M TAAMAH; Ahmed S. Abdullah

doi:10.71229/9av78983

Authors

Shahad Mohamed Tama Department of Computer Science, College of Computer Science and Mathematics, Tikrit University, Iraq
Ahmed S. Abdullah Department of Artificial Intelligence, College of Computer Science and Mathematics, Tikrit University, Iraq

DOI:

https://doi.org/10.71229/9av78983

Keywords:

Medical image enhancement,, Deep learning,, Image denoising, , Transformers, , Systematic review

Abstract

Medical image enhancement plays a pivotal role in improving diagnostic accuracy across various healthcare applications. In recent years, deep learning (DL) techniques have emerged as powerful tools for enhancing medical images, outperforming traditional image processing algorithms. This systematic review provides a comprehensive overview of recent advancements in deep learning architectures applied to medical image enhancement, including Convolutional Neural Networks (CNNs), Generative Adversarial Networks (GANs), U-Net variants, and Vision Transformers (ViTs). We analyze their application across major imaging modalities such as Magnetic Resonance Imaging (MRI), Computed Tomography (CT), Ultrasound, and X-ray. Furthermore, this review highlights key performance metrics, publicly available datasets, and critical open challenges including data scarcity, model interpretability, and clinical deployment. Finally, potential future directions are outlined to bridge the gap between algorithmic developments and practical clinical workflow.

References

[1] LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature, 521(7553), 436–444. https://doi.org/10.1038/nature14539

[2] Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). ImageNet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems, 25, 1097–1105.

[3] Zhang, K., Zuo, W., Chen, Y., Meng, D., & Zhang, L. (2017). Beyond a Gaussian denoiser: Residual learning of deep CNN for image denoising. IEEE Transactions on Image Processing, 26(7), 3142–3155. https://doi.org/10.1109/TIP.2017.2662206

[4] Ronneberger, O., Fischer, P., & Brox, T. (2015). U-Net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015 (pp. 234–241). Springer. https://doi.org/10.1007/978-3-319-24574-4_28

[5] Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2014). Generative adversarial nets. Advances in Neural Information Processing Systems, 27, 2672–2680.

[6] Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., & Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, 30, 5998–6008.

[7] Ho, J., Jain, A., & Abbeel, P. (2020). Denoising diffusion probabilistic models. Advances in Neural Information Processing Systems, 33, 6840–6851.

[8] Chen, H., Zhang, Y., Kalra, M. K., Lin, F., Chen, Y., Liao, P., Zhou, J., & Wang, G. (2017). Low-dose CT with a residual encoder-decoder convolutional neural network. IEEE Transactions on Medical Imaging, 36(12), 2524–2535. https://doi.org/10.1109/TMI.2017.2715284

[9] Yang, Q., Yan, P., Zhang, Y., Yu, H., Shi, Y., Mou, X., Kalra, M. K., Zhang, Y., Sun, L., & Wang, G. (2018). Low-dose CT image denoising using a generative adversarial network with Wasserstein distance and perceptual loss. IEEE Transactions on Medical Imaging, 37(6), 1348–1357. https://doi.org/10.1109/TMI.2018.2827462

[10] Yi, X., Walia, E., & Babyn, P. (2019). Generative adversarial network in medical imaging: A review. Medical Image Analysis, 58, 101552. https://doi.org/10.1016/j.media.2019.101552

[11] Kazeminia, S., Baur, C., Kuijper, A., van Ginneken, B., Navab, N., Albarqouni, S., & Mukhopadhyay, A. (2020). GANs for medical image analysis. Artificial Intelligence in Medicine, 109, 101938. https://doi.org/10.1016/j.artmed.2020.101938

[12] Shamshad, F., Khan, S., Zamir, S. W., Khan, M. H., Hayat, M., Khan, F. S., & Fu, H. (2023). Transformers in medical imaging: A survey. Medical Image Analysis, 88, 102802. https://doi.org/10.1016/j.media.2023.102802

[13] Azad, R., Kazerouni, A., Heidari, M., Aghdam, E. K., Molaei, A., Jia, Y., Jose, A., Roy, R., & Merhof, D. (2024). Advances in medical image analysis with vision Transformers: A comprehensive review. Medical Image Analysis, 91, 103000. https://doi.org/10.1016/j.media.2023.103000

[14] Kazerouni, A., Aghdam, E. K., Heidari, M., Azad, R., Fayyaz, M., Hacihaliloglu, I., & Merhof, D. (2023). Diffusion models in medical imaging: A comprehensive survey. Medical Image Analysis, 88, 102846. https://doi.org/10.1016/j.media.2023.102846

[15] Pain, C. D., Egan, G. F., & Chen, Z. (2022). Deep learning-based image reconstruction and post-processing methods in positron emission tomography for low-dose imaging and resolution enhancement. European Journal of Nuclear Medicine and Molecular Imaging, 49.

[16] Li, Y., Sixou, B., & Peyrin, F. (2021). A review of the deep learning methods for medical images super resolution problems. IRBM, 42(2), 120–133. https://doi.org/10.1016/j.irbm.2020.08.004

[17] Kleber, C. E. J., Karius, R., Naessens, L. E., Van Toledo, C. O., van Osch, J. A. C., Boomsma, M. F., Heemskerk, J. W. T., & van der Molen, A. J. (2024). Advancements in supervised deep learning for metal artifact reduction in computed tomography: A systematic review. European Journal of Radiology.

[18] Pai, R. N., Shuhood, S. M., Shenoy, A., & Poornalatha, G. (2026). Image restoration using deep learning techniques: A comprehensive review. ICT Express, 12(3), 593–609. https://doi.org/10.1016/j.icte.2026.03.002

[19] Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004). Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing, 13(4), 600–612. https://doi.org/10.1109/TIP.2003.819861

[20] Breger, A., Biguri, A., Sabaté Landman, M., Selby, I., Amberg, N., Brunner, E., Gröhl, J., Hatamikia, S., Karner, C., Ning, L., Dittmer, S., Roberts, M., & Schönlieb, C.-B. (2025). A study of why we need to reassess full reference image quality assessment with medical images. Journal of Imaging Informatics in Medicine. https://doi.org/10.1007/s10278-025-01462-1

[21] Ulyanov, D., Vedaldi, A., & Lempitsky, V. (2018). Deep image prior. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 9446–9454).

[22] National Electrical Manufacturers Association. (n.d.). DICOM PS3.1: Digital Imaging and Communications in Medicine (DICOM) – Introduction and overview. https://dicom.nema.org/medical/dicom/current/output/html/part01.html

[23] Gjesteby, L., Yang, Q., Xi, Y., Shan, H., Claus, B., Jin, Y., De Man, B., & Wang, G. (2017). Deep learning methods for CT image-domain metal artifact reduction. Proceedings of SPIE, 10391, 103910W. https://doi.org/10.1117/12.2274427

[24] Kitchenham, B., & Charters, S. (2007). Guidelines for performing systematic literature reviews in software engineering (EBSE Technical Report EBSE-2007-01). Keele University and Durham University.

[25] Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., et al. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ, 372, n71. https://doi.org/10.1136/bmj.n71

[26] Marcos, L., Babyn, P., & Alirezaie, J. (2024). Pure vision Transformer (CT-ViT) with Noise2Neighbors interpolation for low-dose CT image denoising. Journal of Imaging Informatics in Medicine, 37(5), 2669–2687. https://doi.org/10.1007/s10278-024-01108-8

[27] Yang, Z., Chen, H., Qian, Z., Yi, Y., Zhang, H., Zhao, D., Wei, B., & Xu, Y. (2024). All-in-one medical image restoration via task-adaptive routing. In Medical Image Computing and Computer Assisted Intervention – MICCAI 2024. Springer. https://doi.org/10.48550/arXiv.2405.19769

[28] Gu, J., Yang, T. S., Ye, J. C., & Yang, D. H. (2021). CycleGAN denoising of extreme low-dose cardiac CT using wavelet-assisted noise disentanglement. Medical Image Analysis, 74, 102209. https://doi.org/10.1016/j.media.2021.102209

[29] Eulig, E., Ommer, B., & Kachelrieß, M. (2024). Benchmarking deep learning-based low-dose CT image denoising algorithms. Medical Physics. https://doi.org/10.1002/mp.17379

[30] Brateanu, A., Balmez, R., Avram, A., & Orhei, C. (2025). AKDT: Adaptive kernel dilation Transformer for effective image denoising. In Proceedings of the 20th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISAPP 2025). SCITEPRESS.

[31] Nasr, M., Brzostowski, K., Piórkowski, A., & Obuchowicz, R. (2026). Denoising of CT and MRI images using decomposition-based curvelet thresholding and classical filtering techniques. Applied Sciences, 16(3), 1335. https://doi.org/10.3390/app16031335

[32] Choi, H., & Jeong, J. (2020). Despeckling algorithm for removing speckle noise from ultrasound images. Symmetry, 12(6), 938. https://doi.org/10.3390/sym12060938

[33] Hou, Q., Wang, Y., Cao, P., Cheng, S., Lan, L., Yang, J., Liu, X., & Zaiane, O. R. (2024). A collaborative self-supervised domain adaptation for low-quality medical image enhancement. IEEE Transactions on Medical Imaging. https://doi.org/10.1109/TMI.2024.3367367

[34] Luthra, A., Sulakhe, H., Mittal, T., Iyer, A., & Yadav, S. (2021). Eformer: Edge enhancement based Transformer for medical image denoising (arXiv:2109.08044). arXiv. https://doi.org/10.48550/arXiv.2109.08044

[35] Zhu, Z., Rehman, A., Cao, X., Liao, C., Lee, Y. J., Ohliger, M., Xue, H., & Yang, Y. (2024). Advancing low-field MRI with a universal denoising imaging transformer: Towards fast and high-quality imaging (arXiv:2404.19167). arXiv. https://doi.org/10.48550/arXiv.2404.19167

[36] Siju, K. S., Venugopal, V., Kar, M. K., & Anandakrishnan, J. (2026). An interpretable deep learning method for medical image deblurring and restoration. Healthcare Analytics, 9, 100468. https://doi.org/10.1016/j.health.2026.100468

[37] Laves, M.-H., Tölle, M., & Ortmaier, T. (2020). Uncertainty estimation in medical image denoising with Bayesian deep image prior. In Uncertainty for Safe Utilization of Machine Learning in Medical Imaging, and Graphs in Biomedical Image Analysis (UNSURE/GRAIL 2020), LNCS 12443. Springer. https://doi.org/10.1007/978-3-030-60365-6_9

[38] Wu, T., Li, P., Sun, J., & Nguyen, B. P. (2024). Adaptive edge prior-based deep attention residual network for low-dose CT image denoising. Biomedical Signal Processing and Control.

[39] Sharif, S. M. A., Naqvi, R. A., Biswas, M., & Loh, W.-K. (2022). Deep perceptual enhancement for medical image analysis. IEEE Journal of Biomedical and Health Informatics.

[40] Fartiyal, J., Freire, P., Whayeb, Y., Wolffsohn, J. S., Turitsyn, S. K., & Sokolovski, S. G. (2025). Dual path learning – learning from noise and context for medical image denoising (arXiv:2507.19035). arXiv. https://doi.org/10.48550/arXiv.2507.19035

[41] Pawar, A. B., Priya, C., Jaya Rama Krishnaiah, V. V., et al. (2023). Multi-scale deep learning-based recurrent neural network for improved medical image restoration and enhancement. International Journal of Advanced Computer Science and Applications, 14(10).

[42] Kaplan, S., & Zhu, Y.-M. (2019). Full-dose PET image estimation from low-dose PET image using deep learning: A pilot study. Journal of Digital Imaging, 32, 773–778.

[43] Hou, Q., Wang, Y., Lan, L., Cao, P., Yang, J., Liu, X., Wang, M., Tham, Y. C., & Zaiane, O. R. (2023). A reference-free self-supervised domain adaptation framework for low-quality fundus image enhancement. In Proceedings of the 31st ACM International Conference on Multimedia. ACM. https://doi.org/10.1145/3581783.3612049

[44] Marcos, L., Babyn, P., & Alirezaie, J. (2025). Edge detection attention module in pure vision Transformer for low-dose X-ray computed tomography image denoising. Algorithms, 18(3), 134. https://doi.org/10.3390/a18030134

[45] Abuya, T. K., Rimiru, R. M., & Okeyo, G. O. (2023). An image denoising technique using wavelet-anisotropic Gaussian filter-based denoising convolutional neural network for CT images. Applied Sciences, 13(21), 12069. https://doi.org/10.3390/app132112069

[46] Rai, S., Bhatt, J. S., & Patra, S. K. (2021). Augmented noise learning framework for enhancing medical image denoising. IEEE Access, 9.

[47] Song, L., Zhang, Y., Li, M., et al. (2026). BDNet: A real-time biomedical image denoising network with gradient information enhancement loss. Biosensors, 16(1), 26. https://doi.org/10.3390/bios16010026

[48] Sun, H., Peng, L., Zhang, H., He, Y., Cao, S., & Lu, L. (2021). Dynamic PET image denoising using deep image prior combined with regularization by denoising. IEEE Access, 9.

[49] Zhou, Y., Kong, Z., Huang, T., Ahn, E., Li, H., & Ding, L. (2024). WaveletDFDS-Net: A dual forward denoising stream network for low-dose CT noise reduction. Electronics, 13(10), 1906. https://doi.org/10.3390/electronics13101906

[50] Ma, Y., Liu, J., Liu, Y., Fu, H., Hu, Y., Cheng, J., Qi, H., Wu, Y., Zhang, J., & Zhao, Y. (2021). Structure and illumination constrained GAN for medical image enhancement. IEEE Transactions on Medical Imaging, 40(12), 3955–3967.

[51] Kavitha, R., Arunadevi, R., Ishwarya, K., Athinarayanan, S., Robinson Joel, M., & Manikandan, G. (2025). EGAN-F-MIRNet: Enlighten generative adversarial network-fusion-MIRNet for image enhancement of MRI brain image. Biomedical Materials & Devices. https://doi.org/10.1007/s44174-025-00492-1

[52] Naqvi, R. A., Haider, A., Kim, H. S., Jeong, D., & Lee, S.-W. (2024). Transformative noise reduction: Leveraging a Transformer-based deep network for medical image denoising. Mathematics, 12(15), 2313. https://doi.org/10.3390/math12152313

[53] Ma, Y., Yan, Q., Liu, Y., Liu, J., Zhang, J., & Zhao, Y. (2023). StruNet: Perceptual and low-rank regularized Transformer for medical image denoising. Medical Physics. https://doi.org/10.1002/mp.16550

[54] Ma, Y., et al. (2020). Cycle structure and illumination constrained GAN for medical image enhancement. In Medical Image Computing and Computer Assisted Intervention – MICCAI 2020 (LNCS 12262). Springer. https://doi.org/10.1007/978-3-030-59713-9_64

[55] Kim, K., Wu, D., Gong, K., Dutta, J., Kim, J. H., Son, Y. D., Kim, H. K., El Fakhri, G., & Li, Q. (2018). Penalized PET reconstruction using deep learning prior and local linear fitting. IEEE Transactions on Medical Imaging, 37(6), 1478–1487.

[56] Gong, K., Han, P. K., El Fakhri, G., Ma, C., & Li, Q. (2022). Arterial spin labeling MR image denoising and reconstruction using unsupervised deep learning. NMR in Biomedicine, 35(4), e4224. https://doi.org/10.1002/nbm.4224

[57] Nishii, T., Kobayashi, T., Tanaka, H., Kotoku, A., Ohta, Y., Morita, Y., Umehara, K., Ota, J., Horinouchi, H., Ishida, T., & Fukuda, T. (2022). Deep learning–based post hoc CT denoising for myocardial delayed enhancement. Radiology. https://doi.org/10.1148/radiol.220189

[58] Hou, Q., Wang, Y., Cao, P., Ju, J., Tu, H., Liu, X., Yang, J., Fu, H., Tham, Y. C., & Zaiane, O. R. (2026). Pathology-preserving Transformer based on multi-color space for low-quality medical image enhancement. IEEE Transactions on Multimedia.

[59] Zhang, Y., Hao, D., Lin, Y., Sun, W., Zhang, J., Meng, J., Ma, F., Guo, Y., Lu, H., Li, G., & Liu, J. (2023). Structure-preserving low-dose computed tomography image denoising using a deep residual adaptive global context attention network. Quantitative Imaging in Medicine and Surgery.

[60] Mehranian, A., Wollenweber, S. D., Walker, M. D., Bradley, K. M., Fielding, P. A., Huellner, M., Kotasidis, F., Su, K.-H., Johnsen, R., Jansen, F. P., & McGowan, D. R. (2022). Deep learning–based time-of-flight (ToF) image enhancement of non-ToF PET scans. European Journal of Nuclear Medicine and Molecular Imaging, 49.

[61] Eun, D.-I., Jang, R., Ha, W. S., Lee, H., Jung, S. C., & Kim, N. (2020). Deep-learning-based image quality enhancement of compressed sensing magnetic resonance imaging of vessel wall: Comparison of self-supervised and unsupervised approaches. Scientific Reports, 10, 13950. https://doi.org/10.1038/s41598-020-69932-w

[62] Koonjoo, N., Zhu, B., Bagnall, G. C., Bhutto, D., & Rosen, M. S. (2021). Boosting the signal-to-noise of low-field MRI with deep learning image reconstruction. Scientific Reports, 11, 8248. https://doi.org/10.1038/s41598-021-87482-7

[63] Wang, B., Deng, F., Jiang, P., Wang, S., Han, X., & Zhang, Z. (2024). WiTUnet: A U-shaped architecture integrating CNN and Transformer for improved feature alignment and local information fusion. Scientific Reports, 14. https://doi.org/10.1038/s41598-024-76886-w

[64] Yang, D., Lei, H., Shang, L., & Yang, W. (2026). Hierarchical multi-stage complementary network for medical image denoising. Scientific Reports, 65203. https://doi.org/10.1038/s41598-026-65203-2

[65] Muksimova, S., Umirzakova, S., Mardieva, S., & Cho, Y.-I. (2023). Enhancing medical image denoising with innovative teacher–student model-based approaches for precision diagnostics. Sensors, 23(23), 9502. https://doi.org/10.3390/s23239502

[66] Shim, J., & Jo, K. (2025). Siamese denoising autoencoders for enhancing adversarial robustness in medical image analysis. IEEE Access.

[67] Luo, F., Wu, D., Rojas Pino, L., & Ding, W. (2025). A novel multimodel medical image fusion framework with edge enhancement and cross-scale Transformer. Scientific Reports, 15. https://doi.org/10.1038/s41598-025-93616-y

[68] Zhou, L., Zhou, Z., Huang, X., Zhang, X., Wang, H., & Li, G. (2024). Neighboring slice Noise2Noise: Self-supervised medical image denoising from single noisy image volume (arXiv:2411.10831). arXiv. https://doi.org/10.48550/arXiv.2411.10831

[69] Geng, M., Meng, X., Yu, J., Zhu, L., Jin, L., Jiang, Z., Qiu, B., Li, H., Kong, H., Yuan, J., Yang, K., Shan, H., Han, H., Yang, Z., Ren, Q., & Lu, Y. (2022). Content-noise complementary learning for medical image denoising. IEEE Transactions on Medical Imaging, 41(2), 407–419.

[70] Radke, K. L., Kamp, B., Adriaenssens, V., Stabinska, J., Gallinnis, P., Wittsack, H.-J., Antoch, G., & Müller-Lutz, A. (2023). Deep learning-based denoising of CEST MR data: A feasibility study on applying synthetic phantoms in medical imaging. Diagnostics, 13(21), 3326. https://doi.org/10.3390/diagnostics13213326

[71] Liu, R., Xiao, S., Liu, T., Jiang, F., Yuan, C., & Chen, J. (2024). Dual stage MRI image restoration based on blind spot denoising and hybrid attention. BMC Medical Imaging, 24. https://doi.org/10.1186/s12880-024-01437-8

[72] Chen, H., Yang, Z., Hou, H., Zhang, H., Wei, B., Zhou, G., & Xu, Y. (2025). All-in-one medical image restoration with latent diffusion-enhanced vector-quantized codebook prior. In Medical Image Computing and Computer Assisted Intervention – MICCAI 2025. Springer. https://doi.org/10.1007/978-3-032-05325-1_7

[73] Yang, Z., Zhang, J., Yi, Y., Liang, J., Wei, B., & Xu, Y. (2025). TAT: Task-adaptive Transformer for all-in-one medical image restoration. In Medical Image Computing and Computer Assisted Intervention – MICCAI 2025. Springer.