Skip to content

Official code of the paper "Rethinking Infrared Small Target Detection: A Foundation- Driven Efficient Paradigm"

Notifications You must be signed in to change notification settings

YuChuang1205/FDEP-Framework

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

16 Commits
 
 
 
 

Repository files navigation

Rethinking Infrared Small Target Detection: A Foundation-Driven Efficient Paradigm

Chuang Yu1,2,6Jinmiao Zhao1,2,  Yunpeng Liu1*Yaokun Li3,  Xiujun Shu4,
Yuanhao Feng4,  Bo Wang4Yimian Dai5Xiangyu Yue6*

1 Shenyang Institute of Automation, Chinese Academy of Sciences
2 University of Chinese Academy of Sciences   
3 Sun Yat-sen University    4 Tencent    5 Nankai University    6 MMLab, The Chinese University of Hong Kong

💥 Abstract

While large-scale visual foundation models (VFMs) exhibit strong generalization across diverse visual domains, their potential for single-frame infrared small target (SIRST) detection remains largely unexplored. To fill this gap, we systematically introduce the frozen representations from VFMs into the SIRST task for the first time and propose a Foundation-Driven Efficient Paradigm (FDEP), which can seamlessly adapt to existing encoder-decoder-based methods and significantly improve accuracy without additional inference overhead. Specifically, a Semantic Alignment Modulation Fusion (SAMF) module is designed to achieve dynamic alignment and deep fusion of the global semantic priors from VFMs with task-specific features. Meanwhile, to avoid the inference time burden introduced by VFMs, we propose a Collaborative Optimization-based Implicit Self-Distillation (CO-ISD) strategy, which enables implicit semantic transfer between the main and lightweight branches through parameter sharing and synchronized backpropagation. In addition, to unify the fragmented evaluation system, we construct a Holistic SIRST Evaluation (HSE) metric that performs multi-threshold integral evaluation at both pixel-level confidence and target-level robustness, providing a stable and comprehensive basis for fair model comparison. Extensive experiments demonstrate that the SIRST detection networks equipped with our FDEP framework achieve state-of-the-art (SOTA) performance on multiple public datasets.

🚀 Overview


FDEP-Framework-Overview

✅ TODO List

We are finalizing the release of the paper, dataset and code and aim to complete it as soon as possible. Please stay tuned! ⚡⚡⚡

  • Release paper. [Paper/ArXiv]
  • Release training and inference code.

Other link

  1. My homepage: [YuChuang]
  2. My "PAL Framework" project code (ICCV2025):[Link]

About

Official code of the paper "Rethinking Infrared Small Target Detection: A Foundation- Driven Efficient Paradigm"

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published