Skip to content

LiuZhu-CV/DEAL

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 

Repository files navigation

DEAL: Data-Efficient Adversarial Learning for High-Quality Infrared Imaging

Zhu Liu†, Zijun Wang†, Jinyuan Liu‡, Fanqi Meng†, Long Ma†, Risheng Liu†*

†School of Software Technology, Dalian University of Technology ‡School of Mechanical Engineering, Dalian University of Technology

⭐ If DEAL is helpful for you, please help star this repo. Thanks! 🔥🔥🔥

📖 Table Of Contents

⌛ TODO

  • Release Code ​1​.​0:computer:
  • Release benchmark ​

🎆 Abstract

Thermal imaging is often compromised by dynamic, complex degradations caused by hardware limitations and unpredictable environmental factors. The scarcity of high-quality infrared data, coupled with the challenges of dynamic, intricate degradations, makes it difficult to recover details using existing methods. In this paper, we introduce thermal degradation simulation integrated into the training process via a mini-max optimization, by modeling these degraded factors as adversarial attacks on thermal images. The simulation is dynamic to maximize objective functions, thus capturing a broad spectrum of degraded data distributions. This approach enables training with limited data, thereby improving model performance. Additionally, we introduce a dual-interaction network that combines the benefits of spiking neural networks with scale transformation to capture degraded features with sharp spike signal inten- sities. This architecture ensures compact model parameters while preserving eficient feature representation. Extensive experiments demonstrate that our method not only achieves superior visual quality under diverse single and composited degradation, but also delivers a significant reduction in processing when trained on only fifty clear images, outperforming existing techniques in eficiency and accuracy.

👀 Framework Overview

main_00

⭐ Overview of DEAL. We present a data-efficient adversarial learning strategy, which constructs the dynamic degradation generation to guide the image enhancement procedure with a Dynamic Adversarial Solution (DAS) at (a). The concrete architecture of dual interaction network, consisting of Scale Transform Module (STM) and Spiking-guided Separation Module (SSM) is shown at (b). Spiking-guided Separation to capture sharp intensities of thermal degradations is depicted at (c).

📈 Visual Display

Visual display on stripe noise

stripe_00

Visual display on super-resolution

SR4_00

Visual display on composited degradation

混合降秩_00

⚙️ Setup

conda env create -f environment.yaml

We will compile as many infrared enhancement-related comparison methods and our experimental results as possible into the following link as soon as possible.

🔧 Training

Step1: Prepare training data

We train the DEAL on M3FD [Baidu Netdisk] . The final 50 photos used for training are here.

Step2: Training for DEAL

cd /DEAL/DEAL1.0/scripts

python train.py

💫 Test

Step1: Download the pretrained models

If you want to perform some tests on our model, download the pretrained model [Baidu Netdisk]

Step3: Inference for DEAL

run:

cd 
python Load_Ours.py

😃 Citation

Please cite us if our work is useful for your research.

@inproceedings{liu2025deal,
  title={DEAL: Data-Efficient Adversarial Learning for High-Quality Infrared Imaging},
  author={Liu, Zhu and Wang, Zijun and Liu, Jinyuan and Meng, Fanqi and Ma, Long and Liu, Risheng},
  booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  year={2025}
}

✉️ Contact

If you have any questions, please feel free to contact liuzhu@mail.dlut.edu.cn, wzijun6@gmail.com, mengfq0525@gmail.com.

About

DEAL: Data-Efficient Adversarial Learning for High-Quality Infrared Imaging (CVPR 25)

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages