Authors
Zhu Liu, Qilong Zhao, Zhirui Fang, Benzhuang Zhang, Jinyuan Liu, Risheng Liu
Published in
IEEE transactions on pattern analysis and machine intelligence. Volume PP. Nov 18, 2026. Epub Nov 18, 2026.
Abstract
Infrared visual perception fundamentally differs from visible-domain vision due to its distinct thermal imaging mechanism and varying imaging conditions. Existing methods typically decouple data construction from model transfer, overlooking their interdependence: model accuracy and robustness depend critically on the coverage and composition of training observations, while effective model transfer requires explicit modeling of infrared-specific imaging characteristics. To address this issue, we propose a data-model collaborative transfer framework for infrared visual perception. At the data level, a task-responsive generator learns weights over a feasible infrared imaging-variation space to construct informative training observations. At the model level, a formation-guided representation module derives complementary radiance-structure and response-detail descriptors from infrared observations. We further design a thermal-aware adapter that uses these descriptors to modulate intermediate representations and produce lightweight residual corrections for model transfer. A single-loop training strategy coordinates data generation, representation learning, and adapter optimization without expensive nested optimization. Extensive experiments on image enhancement, depth estimation, small-target detection, and semantic segmentation demonstrate consistent performance improvements across multiple foundation-model backbones with a small trainable parameter budget.
PMID:
43050379
Bibliographic data and abstract were imported from PubMed on 19 Nov 2026.
Read full publication at:
Please sign in
to see all details.
Advertisement
Stats
- Recommendations n/a n/a positive of 0 vote(s)
- Views 2
- Comments 0