Year
Month
(Preprint) Towards Understanding the Generative Capability of Adversarially Robust Classifiers
Yao Zhu ¹, Jiacheng Ma ², Jiacheng Sun ², Zewei Chen ², Rongxin Jiang 蒋荣欣 ¹, Zhenguo Li ²
¹ Zhejiang University
浙江大学
² Huawei Noah’s Ark Lab
华为诺亚方舟实验室
arXiv, 2021-08-20
Abstract

Recently, some works found an interesting phenomenon that adversarially robust classifiers can generate good images comparable to generative models. We investigate this phenomenon from an energy perspective and provide a novel explanation. We reformulate adversarial example generation, adversarial training, and image generation in terms of an energy function. We find that adversarial training contributes to obtaining an energy function that is flat and has low energy around the real data, which is the key for generative capability.

Based on our new understanding, we further propose a better adversarial training method, Joint Energy Adversarial Training (JEAT), which can generate high-quality images and achieve new state-of-the-art robustness under a wide range of attacks. The Inception Score of the images (CIFAR-10) generated by JEAT is 8.80, much better than original robust classifiers (7.50). In particular, we achieve new state-of-the-art robustness on CIFAR-10 (from 57.20% to 62.04%) and CIFAR-100 (from 30.03% to 30.18%) without extra training data.
Towards Understanding the Generative Capability of Adversarially Robust Classifiers_1
Towards Understanding the Generative Capability of Adversarially Robust Classifiers_2
Towards Understanding the Generative Capability of Adversarially Robust Classifiers_3
  • High-resolution tumor marker detection based on microwave photonics demodulated dual wavelength fiber laser sensor
  • Jie Hu, Weihao Lin, Liyang Shao, Chenlong Xue, Fang Zhao, Dongrui Xiao, Yang Ran, Yue Meng, Panpan He, Zhiguang Yu, Jinna Chen, Perry Ping Shum
  • Opto-Electronic Advances
  • 2024-12-16
  • High performance laser induced plasma assisted ablation by GHz burst mode femtosecond pulses
  • Jingbo Yin, Yulong Zhao, Minghui Hong
  • Opto-Electronic Advances
  • 2024-12-16
  • Sequential harmonic spin–orbit angular momentum generation in nonlinear optical crystals
  • Yutao Tang, Zixian Hu, Junhong Deng, Kingfai Li, Guixin Li
  • Opto-Electronic Advances
  • 2024-12-16
  • Design, setup, and facilitation of the speckle structured illumination endoscopic system
  • Elizabeth Abraham, Zhaowei Liu
  • Opto-Electronic Science
  • 2024-12-13
  • Ultra-high-Q photonic crystal nanobeam cavity for etchless lithium niobate on insulator (LNOI) platform
  • Zhi Jiang, Cizhe Fang, Xu Ran, Yu Gao, Ruiqing Wang, Jianguo Wang, Danyang Yao, Xuetao Gan, Yan Liu, Yue Hao, Genquan Han
  • Opto-Electronic Advances
  • 2024-10-31
  • Advanced biological imaging techniques based on metasurfaces
  • Yongjae Jo, Hyemi Park, Hyeyoung Yoon, Inki Kim
  • Opto-Electronic Advances
  • 2024-10-31
  • Orthogonal matrix of polarization combinations: concept and application to multichannel holographic recording
  • Shujun Zheng, Jiaren Tan, Hongjie Liu, Xiao Lin, Yusuke Saita, Takanori Nomura, Xiaodi Tan
  • Opto-Electronic Advances
  • 2024-10-23
  • Streamlined photonic reservoir computer with augmented memory capabilities
  • Changdi Zhou, Yu Huang, Yigong Yang, Deyu Cai, Pei Zhou, Kuenyao Lau, Nianqiang Li, Xiaofeng Li
  • Opto-Electronic Advances
  • 2024-10-22
  • High-precision multi-focus laser sculpting of microstructured glass
  • Kang Xu, Peilin Huang, Lingyu Huang, Li Yao, Zongyao Li, Jiantao Chen, Li Zhang, Shaolin Xu
  • Opto-Electronic Advances
  • 2024-10-09
  • Multi-physical field null medium: new solutions for the simultaneous control of EM waves and heat flow
  • Sailing He, Ruili Zhang, Junbo Liang
  • Opto-Electronic Advances
  • 2024-09-30
  • Adaptive decentralized AI scheme for signal recognition of distributed sensor systems
  • Shixiong Zhang, Hao Li, Cunzheng Fan, Zhichao Zeng, Chao Xiong, Jie Wu, Zhijun Yan, Deming Liu, Qizhen Sun
  • Opto-Electronic Advances
  • 2024-09-29
  • Data-driven polarimetric approaches fuel computational imaging expansion
  • Sylvain Gigan
  • Opto-Electronic Advances
  • 2024-09-28



  • Context-Aware Candidates for Image Cropping                                Image Cropping Assisted By Modeling Inter-Patch Relations
    About
    |
    Contact
    |
    Copyright © PubCard