Year
Month
(Preprint) Boosting the Generalization Capability in Cross-Domain Few-shot Learning via Noise-enhanced Supervised Autoencoder
Hanwen Liang ¹, Qiong Zhang 张琼 ², Peng Dai ¹, Juwei Lu ¹
¹ Huawei Noah’s Ark Lab, Canada
加拿大 华为诺亚方舟实验室
² Department of Statistics, University of British Columbia, Vancouver, Canada
arXiv, 2021-08-11
Abstract

State of the art (SOTA) few-shot learning (FSL) methods suffer significant performance drop in the presence of domain differences between source and target datasets. The strong discrimination ability on the source dataset does not necessarily translate to high classification accuracy on the target dataset.

In this work, we address this cross-domain few-shot learning (CDFSL) problem by boosting the generalization capability of the model. Specifically, we teach the model to capture broader variations of the feature distributions with a novel noise-enhanced supervised autoencoder (NSAE).

NSAE trains the model by jointly reconstructing inputs and predicting the labels of inputs as well as their reconstructed pairs. Theoretical analysis based on intra-class correlation (ICC) shows that the feature embeddings learned from NSAE have stronger discrimination and generalization abilities in the target domain. We also take advantage of NSAE structure and propose a two-step fine-tuning procedure that achieves better adaption and improves classification performance in the target domain.

Extensive experiments and ablation studies are conducted to demonstrate the effectiveness of the proposed method. Experimental results show that our proposed method consistently outperforms SOTA methods under various conditions.
Boosting the Generalization Capability in Cross-Domain Few-shot Learning via Noise-enhanced Supervised Autoencoder_1
Boosting the Generalization Capability in Cross-Domain Few-shot Learning via Noise-enhanced Supervised Autoencoder_2
Boosting the Generalization Capability in Cross-Domain Few-shot Learning via Noise-enhanced Supervised Autoencoder_3
Boosting the Generalization Capability in Cross-Domain Few-shot Learning via Noise-enhanced Supervised Autoencoder_4
  • On-chip light control of semiconductor optoelectronic devices using integrated metasurfaces
  • Cheng-Long Zheng, Pei-Nan Ni, Yi-Yang Xie, Patrice Genevet
  • Opto-Electronic Advances
  • 2025-01-07
  • Ferroelectric domain engineering of lithium niobate
  • Jackson J. Chakkoria, Aditya Dubey, Arnan Mitchell, Andreas Boes
  • Opto-Electronic Advances
  • 2025-01-03
  • Smart reconfigurable metadevices made of shape memory alloy metamaterials
  • Shiqiang Zhao, Yuancheng Fan, Ruisheng Yang, Zhehao Ye, Fuli Zhang, Chen Wang, Weijia Luo, Yongzheng Wen, Ji Zhou
  • Opto-Electronic Advances
  • 2025-01-03
  • Direct detection with an optimal transfer function: toward the electrical spectral efficiency of coherent homodyne detection
  • Xingfeng Li, Jingchi Li, Xiong Ni, Hudi Liu, Qunbi Zhuge, Haoshuo Chen, William Shieh, Yikai Su
  • Opto-Electronic Science
  • 2024-12-24
  • Enhanced amplified spontaneous emission via splitted strong coupling mode in large-area plasmonic cone lattices
  • Jiazhi Yuan, Jiang Hu, Yan Zheng, Hao Wei, Jiamin Xiao, Yi Wang, Xuchao Zhao, Ye Xiang, Yong Lei, Wenxin Wang
  • Opto-Electronic Science
  • 2024-12-19
  • High-resolution tumor marker detection based on microwave photonics demodulated dual wavelength fiber laser sensor
  • Jie Hu, Weihao Lin, Liyang Shao, Chenlong Xue, Fang Zhao, Dongrui Xiao, Yang Ran, Yue Meng, Panpan He, Zhiguang Yu, Jinna Chen, Perry Ping Shum
  • Opto-Electronic Advances
  • 2024-12-16
  • High performance laser induced plasma assisted ablation by GHz burst mode femtosecond pulses
  • Jingbo Yin, Yulong Zhao, Minghui Hong
  • Opto-Electronic Advances
  • 2024-12-16
  • Sequential harmonic spin–orbit angular momentum generation in nonlinear optical crystals
  • Yutao Tang, Zixian Hu, Junhong Deng, Kingfai Li, Guixin Li
  • Opto-Electronic Advances
  • 2024-12-16
  • Design, setup, and facilitation of the speckle structured illumination endoscopic system
  • Elizabeth Abraham, Zhaowei Liu
  • Opto-Electronic Science
  • 2024-12-13
  • Ultra-high-Q photonic crystal nanobeam cavity for etchless lithium niobate on insulator (LNOI) platform
  • Zhi Jiang, Cizhe Fang, Xu Ran, Yu Gao, Ruiqing Wang, Jianguo Wang, Danyang Yao, Xuetao Gan, Yan Liu, Yue Hao, Genquan Han
  • Opto-Electronic Advances
  • 2024-10-31
  • Advanced biological imaging techniques based on metasurfaces
  • Yongjae Jo, Hyemi Park, Hyeyoung Yoon, Inki Kim
  • Opto-Electronic Advances
  • 2024-10-31
  • Orthogonal matrix of polarization combinations: concept and application to multichannel holographic recording
  • Shujun Zheng, Jiaren Tan, Hongjie Liu, Xiao Lin, Yusuke Saita, Takanori Nomura, Xiaodi Tan
  • Opto-Electronic Advances
  • 2024-10-23



  • Retrieval & Interaction Machine for Tabular Data Prediction                                All-climate aqueous Na-ion batteries using “Water-in-Salt” electrolyte
    About
    |
    Contact
    |
    Copyright © PubCard