Open AccessOpen Access

ARTICLE

Classification Similarity Network Model for Image Fusion Using Resnet50 and GoogLeNet

P. Siva Satya Sreedhar1,*, N. Nandhagopal2

1 Faculty of Information and Communication Engineering, Anna University, Chennai, 600025, India
2 Department of Electronics and Communication Engineering, Excel Engineering College, Namakkal, 637303, India

* Corresponding Author: P. Siva Satya Sreedhar. Email:

Intelligent Automation & Soft Computing 2022, 31(3), 1331-1344. https://doi.org/10.32604/iasc.2022.020918

Abstract

The current trend in Image Fusion (IF) algorithms concentrate on the fusion process alone. However, pay less attention to critical issues such as the similarity between the two input images, features that participate in the Image Fusion. This paper addresses these two issues by deliberately attempting a new Image Fusion framework with Convolutional Neural Network (CNN). CNN has features like pre-training and similarity score, but functionalities are limited. A CNN model with classification prediction and similarity estimation are introduced as Classification Similarity Networks (CSN) to address these issues. ResNet50 and GoogLeNet are modified as the classification branches of CSN v1, CSN v2, respectively, to reduce feature dimensions. IF rules depend on the input dataset to fusion the extracted features. The output of the fusion process is fed into CSN v3 to improve the output image quality. The proposed CSN model is pre-trained and Fully Convolutional. At the time of IF, consider the similarities between the input images. This model applies to Multi-Focus, Multi-Modal Medical, Infrared-Visual and Multi-Exposure image datasets, and analyzed outcomes. The suggested model shows a significant improvement than the modern IF algorithms.

Keywords


Cite This Article

P. Siva Satya Sreedhar and N. Nandhagopal, "Classification similarity network model for image fusion using resnet50 and googlenet," Intelligent Automation & Soft Computing, vol. 31, no.3, pp. 1331–1344, 2022.



This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
  • 1408

    View

  • 931

    Download

  • 0

    Like

Share Link

WeChat scan