Year
Month
(Preprint) Amplitude-Phase Recombination: Rethinking Robustness of Convolutional Neural Networks in Frequency Domain
Guangyao Chen 陈光耀 ¹, Peixi Peng 彭佩玺 ¹ ³, Li Ma 马力 ¹ ³, Jia Li 李甲 ² ³, Lin Du ⁴, Yonghong Tian 田永鸿 ¹ ³
¹ Department of Computer Science and Technology, Peking University
北京大学计算机科学技术系
² State Key Laboratory of Virtual Reality Technology and Systems, SCSE, Beihang University
北京航空航天大学 虚拟现实技术与系统国家重点实验室
³ Peng Cheng Laborotory
鹏城实验室
⁴ AI Application Research Center, Huawei
华为AI应用研究中心
arXiv, 2021-08-19
Abstract

Recently, the generalization behavior of Convolutional Neural Networks (CNN) is gradually transparent through explanation techniques with the frequency components decomposition. However, the importance of the phase spectrum of the image for a robust vision system is still ignored. In this paper, we notice that the CNN tends to converge at the local optimum which is closely related to the high-frequency components of the training images, while the amplitude spectrum is easily disturbed such as noises or common corruptions.

In contrast, more empirical studies found that humans rely on more phase components to achieve robust recognition. This observation leads to more explanations of the CNN's generalization behaviors in both robustness to common perturbations and out-of-distribution detection, and motivates a new perspective on data augmentation designed by re-combing the phase spectrum of the current image and the amplitude spectrum of the distracter image. That is, the generated samples force the CNN to pay more attention to the structured information from phase components and keep robust to the variation of the amplitude.

Experiments on several image datasets indicate that the proposed method achieves state-of-the-art performances on multiple generalizations and calibration tasks, including adaptability for common corruptions and surface variations, out-of-distribution detection, and adversarial attack.
Amplitude-Phase Recombination: Rethinking Robustness of Convolutional Neural Networks in Frequency Domain_1
Amplitude-Phase Recombination: Rethinking Robustness of Convolutional Neural Networks in Frequency Domain_2
Amplitude-Phase Recombination: Rethinking Robustness of Convolutional Neural Networks in Frequency Domain_3
Amplitude-Phase Recombination: Rethinking Robustness of Convolutional Neural Networks in Frequency Domain_4
  • Scaling metasurface design: from reusable unit cells to full-metasurface inverse design
  • Eunbi Jang, Jiwan Hong, Ho-Jun Lee, Seokju Choi, Hyewon Suk, Chanik Kang, Sunae So, Haejun Chung
  • Opto-Electronic Science
  • 2026-10-20
  • Ultrafast all-optical biomimetic encoder for spiking neural networks
  • Qijun Bian, Fangchen Hu, Junlian Jia, Aolong Sun, Sizhe Xing, Boyu Dong, An Yan, Ziwei Li, Jianyang Shi, Nan Chi, Junwen Zhang
  • Opto-Electronic Science
  • 2026-10-20
  • Windmill-shaped multi-unit piezoelectric ceramic tuning fork for cooperatively enhanced photoacoustic methane sensing
  • Botao Liu, Guowei Han, Runqiu Wang, Xuan Yang, Haiyue Sun, Shunda Qiao, Ying He, Angelo Sampaolo, Vincenzo Spagnolo, Yufei Ma
  • Opto-Electronic Science
  • 2026-10-20
  • Ultrafast laser direct writing of highly conductive copper micropatterns
  • Songyan Xue, Chunsan Deng, Mingduo Zhang, Huace Hu, Fayu Chen, Leimin Deng, Jianguo Liu, Hui Gao, Wei Xiong
  • Opto-Electronic Manufacturing
  • 2026-09-30
  • Recent advances in fiber-tip integration based on femtosecond laser 3D printing
  • Yuye Xuan, Dezhi Zhu, Dejun Liu, Ying Wang, Yiping Wang, Changrui Liao
  • Opto-Electronic Manufacturing
  • 2026-09-30
  • Neural holography enabled multi-beam steering for multi-task classifier
  • Lin Wu, Mian Wu, Zhen Li, Ying Qiu, Zichen Liu, Yongquan Zeng, Guozhen Liang, Hanbing Li, Guoxing Zheng, Zhixue He, Xi Xiao, Qi Jie Wang, Jin Tao, Shaohua Yu
  • Opto-Electronic Technology
  • 2026-09-30
  • Laser direct writing of nonlinear metasurfaces on phase-change material Ge₂Sb₂Te₅ for enhanced third harmonic generation
  • Lanpeng Guo, Haochong Liu, Shixin Gao, Ming Tang, Minghui Hong, Tun Cao
  • Opto-Electronic Technology
  • 2026-09-30
  • Nearly vertically emitted nonlinear light sources with high efficiencies enabled by high-Q nearly-degenerate polygon modes
  • Chuntao Li, Yingnuo Qiu, Renhong Gao, Lingling Qiao, Jielei Ni, Min Wang, Jintian Lin, Ya Cheng
  • Opto-Electronic Technology
  • 2026-09-30
  • Multiple degrees-of-freedom optical encryption via pixel-resolved vectorial holography
  • Jianzhong Peng, Haoxian Zhou, Mengzhe Shen, Dapeng Wang, Yu Chen, Renlong Zhang, Fangrui Lin, Xiaoyu Weng, Junle Qu
  • Opto-Electronic Technology
  • 2026-09-30
  • Recent progress on mid-infrared and terahertz dual-comb spectroscopy
  • Zhuoren Wan, Min Li, Binbin Liu, Yu Xia, Yuan Chen, Xiuxiu Zhang, Dongxu Zhu, Yan Dai, Sinan Tao, Hua Li, Ming Yan, Heping Zeng
  • Opto-Electronic Technology
  • 2026-09-30
  • Optical packaging of photonic integrated circuits: bottlenecks and potential solutions
  • Rodrigo Rendeiro, Hugo Neto, Diogo Vaz, Carla Rodrigues, Heming Wei, Jan Nedoma, Antonio Teixeira, Francisco Rodrigues, Carlos Marques
  • Opto-Electronic Technology
  • 2026-09-30



  • Blind Estimation of Sparse Simo Channels: Quadratic Vs. Linear Constraints                                A Non-Stationary Channel Model with Correlated NLoS/LoS States for ELAA-mMIMO
    About
    |
    Contact
    |
    Copyright © PubCard