Hierarchical Progressive Network for Multimodal Medical Image Fusion in Healthcare Systems

Datos Bibliográficos

ID22106909
AutoresSihan Yang (0009-0007-1097-3040, Sichuan University), Xiaomin Yang (0000-0002-1094-3841, Sichuan University), Rongzhu Zhang (0000-0003-2797-2443, Sichuan University), Kai Liu (0000-0002-7995-6456, Sichuan University)
Año2023
Volumen10
Número4
Páginas1540-1558
Fecha de publicación2023-08-01
Open AccessSí
TipoARTICLE
RevistaIEEE Transactions on Computational Social Systems (JOURNAL)
Identificadores de la revistaISSN: 2329-924X • E-ISSN: 2373-7476
EditorialInstitute of Electrical and Electronics Engineers (IEEE) (PUBLISHER)
DOI10.1109/tcss.2022.3165559
OpenAlexW4226322172
IdiomaEN
Citas recibidas2
Referencias citadas62

Deep learning (DL)-based multisource information processing plays an essential role in the Internet of Medical Things (IoMT). In this field, medical image fusion integrates scan results from different devices, supporting healthcare systems to make a more informed diagnosis. This study proposes a DL-based network to fuse multimodal medical images. In our method, the lattice unit (LU) is designed to improve the representation capability of the fusion network. Moreover, to acquire hierarchical features from images, the progressive module (PM) treats the network’s shallow and deep layers differently. The shallow layers represent the structure of the source image; the deep layers correspond to details. Different loss functions are utilized for these two kinds of information to retain fused images’ salient structures and functional information. Experiments show that the proposed algorithm performs well on visual quality and objective evaluation, which provides a reliable reference for medical diagnosis. In addition, this method is lightweight and speedy compared to existing algorithms, facilitating further placement in the IoMT’s specific devices

Computer vision · Deep learning · Image fusion · Image processing · Information fusion · Salient · The Internet · Visualization · World Wide Web · Advanced Image Fusion Techniques · Computer Science · Engineering · Image and Signal Denoising Methods · Image Enhancement Techniques · Artificial Intelligence

Herramientas

Abrir DOI