(Peer-Reviewed) High performance "non-local" generic face reconstruction model using the lightweight Speckle-Transformer (SpT) UNet
Yangyundou Wang 王杨云逗 ¹ ², Hao Wang 王昊 ³, Min Gu 顾敏 ¹ ²
¹ Institute of Photonic Chips, University of Shanghai for Science and Technology, Shanghai 200093, China
中国 上海 上海理工大学光子芯片研究院
² Centre for Artificial-Intelligence Nanophotonics, School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China
中国 上海 上海理工大学 光电信息与计算机工程学院 人工智能纳米光子学中心
³ School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China
中国 上海 上海理工大学 光电信息与计算机工程学院
Opto-Electronic Advances, 2023-02-25
Abstract
Significant progress has been made in computational imaging (CI), in which deep convolutional neural networks (CNNs) have demonstrated that sparse speckle patterns can be reconstructed. However, due to the limited “local” kernel size of the convolutional operator, for the spatially dense patterns, such as the generic face images, the performance of CNNs is limited.
Here, we propose a “non-local” model, termed the Speckle-Transformer (SpT) UNet, for speckle feature extraction of generic face images. It is worth noting that the lightweight SpT UNet reveals a high efficiency and strong comparative performance with Pearson Correlation Coefficient (PCC), and structural similarity measure (SSIM) exceeding 0.989, and 0.950, respectively.
A 36 × 240 Gbps hybrid mode/wavelength division multiplexing transmitter using lithium niobate on insulator
Mingyu Zhu, Weihan Wang, Ruitao Ma, Aoyun Gao, Chun Gao, Zexu Wang, Fei Huang, Zhenyuan Bao, Dajian Liu, Jiaxuan Gan, Zejie Yu, Huan Li, Weike Zhao, Daoxin Dai
Opto-Electronic Advances
2026-08-25
Light-perception-based interactive control of an underwater digital twin hand
Jinlong Lu, Chao Zhang, Hengchang Nong, Dongying Wang, Hongyu Zhou, Junjie Weng, Yuehua Deng, Yang Yu, Qiang Bian, Jianfa Zhang, Chaofan Zhang, Zhenrong Zhang, Junbo Yang
Opto-Electronic Advances
2026-07-10
Unlocking home-based nocturnal health management: A fiber-optic approach for early detection of cardiorespiratory rhythm disorders
Hanyu Jin, Hao Li, Zhuolin Chen, Liangye Li, Zurui Wang, Kai Zhou, Weijian Hang, Zhipeng Chen, Junfeng Chen, Kai Shen, Jianfeng Wen, Chen Chen, Cunzheng Fan, Zhijun Yan, Feng Wang, Qizhen Sun
Opto-Electronic Advances
2026-07-10
A flexible wireless system for prospective photodynamic therapy applications
Rolan Mansour, Bhavani Yalagala, Vikas Vikas, Nikolas Bruce, Fawziye Tarhini, Georgios N. Arvanitakis, Mohammed Mughal, Jamie Blanche, Ahmad Taha, Jonathan Copper, Muhammad Imran, Karin Williams, Karin Oien, Mahmoud Wagih, Hadi Heidari, Robert Hadfield, David Flynn
Opto-Electronic Advances
2026-07-10
Parallel bright-field and multi-order edge imaging via wide field-of-view trichannel metalens
Xiaotong Li, Yeseul Kim, Youngsun Jeon, Junhwa Seong, Jaekyung Kim, Peng Tang, Shiqi Hu, Harit Keawmuang, Beomha Yang, Dongmin Jeon, Le Dai, Weiyan Li, Xiaodong Cai, Jinhui Shi, Yong-Sang Ryu, Trevon Badloe, Junsuk Rho
Opto-Electronic Advances
2026-07-10
