(Peer-Reviewed) High performance "non-local" generic face reconstruction model using the lightweight Speckle-Transformer (SpT) UNet
Yangyundou Wang 王杨云逗 ¹ ², Hao Wang 王昊 ³, Min Gu 顾敏 ¹ ²
¹ Institute of Photonic Chips, University of Shanghai for Science and Technology, Shanghai 200093, China
中国 上海 上海理工大学光子芯片研究院
² Centre for Artificial-Intelligence Nanophotonics, School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China
中国 上海 上海理工大学 光电信息与计算机工程学院 人工智能纳米光子学中心
³ School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China
中国 上海 上海理工大学 光电信息与计算机工程学院
Opto-Electronic Advances, 2023-02-25
Abstract
Significant progress has been made in computational imaging (CI), in which deep convolutional neural networks (CNNs) have demonstrated that sparse speckle patterns can be reconstructed. However, due to the limited “local” kernel size of the convolutional operator, for the spatially dense patterns, such as the generic face images, the performance of CNNs is limited.
Here, we propose a “non-local” model, termed the Speckle-Transformer (SpT) UNet, for speckle feature extraction of generic face images. It is worth noting that the lightweight SpT UNet reveals a high efficiency and strong comparative performance with Pearson Correlation Coefficient (PCC), and structural similarity measure (SSIM) exceeding 0.989, and 0.950, respectively.
Triplet exciton harvesting via TADF in hafnium chlorides array scintillator screen enables ultrahigh-resolution X-ray imaging
Jun'an Lai, Yi Ye, Xu Liu, Sijun Cao, Shiji Zhou, Wenxia Zhang, Kang An, Peng He, Tingming Jiang, Xiaosheng Tang, Rui Zhou, Dong Zhang
Opto-Electronic Advances
2026-06-08
Vacancy oscillating mode in amorphous binary oxide film by terahertz time domain spectroscopy
Huan Liu, Haiyun Huang, Heng Yu, Zhi Gong, Fei Yu, Zheng Zhang, Zhiyong Tan, Juncheng Cao, Haiyun Liu, Kan-Hao Xue, Xiangshui Miao, Yan Liu, Yue Hao, Genquan Han, Qihua Xiong
Opto-Electronic Advances
2026-06-08
Emerging optical techniques for sorting and detection of chiral particles
Yuzhi Shi, Chengfeng Li, Xiaolei Lin, Wenwen Xue, Chengxing Lai, Tao He, Qinghua Song, Zhanshan Wang, Yulan Wang, Din Ping Tsai, Xinbin Cheng, Haidong Zou
Opto-Electronic Advances
2026-06-08
Phonon-assisted absorption photoconductive switch
Zhao Wang, Lixin Zhang, Lu Cheng, Danwen Zhang, Yu Lu, Naiji Zhang, Xin Zhang, Duanyang Chen, Zhan Sui, Hongji Qi, Wei Zheng
Opto-Electronic Science
2026-05-25
Photonic spiking reinforcement learning for intelligent routing
Shuiying Xiang, Yonghang Chen, Ling Zheng, Zhicong Tu, Xintao Zeng, Mengting Yu, Shuai Wang, Yahui Zhang, Xingxing Guo, Weitao Pan, Yue Hao
Opto-Electronic Science
2026-05-25
