Daily Arxiv

This is a page that curates AI-related papers published worldwide.
All content here is summarized using Google Gemini and operated on a non-profit basis.
Copyright for each paper belongs to the authors and their institutions; please make sure to credit the source when sharing.

RAPNet: A Receptive-Field Adaptive Convolutional Neural Network for Pansharpening

Created by
  • Haebom

Author

Tao Tang, Chengxu Yang

Outline

This study explores a pan-sharpening technique that integrates high-resolution panchromatic (PAN) images with low-resolution multispectral (MS) images to generate high-quality fused images. To overcome the limitation of spatially constant convolution operations in existing CNN-based pan-sharpening techniques, we propose a novel architecture, RAPNet, which uses receptive field adaptive convolution (RAPConv) that adaptively changes according to local features. RAPNet integrates RAPConv with an attention-driven pan-sharpening dynamic feature fusion (PAN-DFF) module to optimally balance spatial resolution and spectral accuracy. Experimental results using public datasets demonstrate that RAPNet outperforms existing methods in both quantitative and qualitative evaluations, and additional ablation studies demonstrate the effectiveness of the proposed adaptive component.

Takeaways, Limitations

Takeaways:
Overcoming the limitations of existing CNN-based pan-sharpening through content-adaptive convolution that considers local region features.
An effective architecture is presented that simultaneously improves spatial resolution and spectral accuracy by integrating RAPConv and PAN-DFF modules.
Demonstrated superior performance compared to existing methods on various public datasets.
Limitations:
Lack of analysis of the computational complexity and execution time of the proposed RAPNet.
Further validation of generalization performance on various types of image data is needed.
Lack of detailed explanation of hyperparameter optimization strategies of RAPConv and PAN-DFF modules.
👍