Year
Month
(Preprint) Real-time Image Enhancer via Learnable Spatial-aware 3D Lookup Tables
Tao Wang 汪涛, Yong Li 李勇, Jingyang Peng 彭竞阳, Yipeng Ma 马翼鹏, Xian Wang 王宪, Fenglong Song 宋风龙, Youliang Yan 颜友亮
¹ Huawei Noah’s Ark Lab
中国 华为诺亚方舟实验室
arXiv, 2021-08-19
Abstract

Recently, deep learning-based image enhancement algorithms achieved state-of-the-art (SOTA) performance on several publicly available datasets. However, most existing methods fail to meet practical requirements either for visual perception or for computation efficiency, especially for high-resolution images. In this paper, we propose a novel real-time image enhancer via learnable spatial-aware 3-dimentional lookup tables(3D LUTs), which well considers global scenario and local spatial information. Specifically, we introduce a light weight two-head weight predictor that has two outputs. One is a 1D weight vector used for image-level scenario adaptation, the other is a 3D weight map aimed for pixel-wise category fusion.

We learn the spatial-aware 3D LUTs and fuse them according to the aforementioned weights in an end-to-end manner. The fused LUT is then used to transform the source image into the target tone in an efficient way. Extensive results show that our model outperforms SOTA image enhancement methods on public datasets both subjectively and objectively, and that our model only takes about 4ms to process a 4K resolution image on one NVIDIA V100 GPU.
Real-time Image Enhancer via Learnable Spatial-aware 3D Lookup Tables_1
Real-time Image Enhancer via Learnable Spatial-aware 3D Lookup Tables_2
Real-time Image Enhancer via Learnable Spatial-aware 3D Lookup Tables_3
  • Three-dimensional multichannel waveguide grating filters
  • Si-Yu Yin, Qi Guo, Shan-Ren Liu, Ju-Wei He, Yong-Sen Yu, Zhen-Nan Tian, Qi-Dai Chen
  • Opto-Electronic Science
  • 2024-08-14
  • Ka-Band metalens antenna empowered by physics-assisted particle swarm optimization (PA-PSO) algorithm
  • Shibin Jiang, Wenjun Deng, Zhanshan Wang, Xinbin Cheng, Din Ping Tsai, Yuzhi Shi, Weiming Zhu
  • Opto-Electronic Science
  • 2024-07-26
  • Complete-basis-reprogrammable coding metasurface for generating dynamically-controlled holograms under arbitrary polarization states
  • Zuntian Chu, Xinqi Cai, Ruichao Zhu, Tonghao Liu, Huiting Sun, Tiefu Li, Yuxiang Jia, Yajuan Han, Shaobo Qu, Jiafu Wang
  • Opto-Electronic Advances
  • 2024-07-26
  • Optical micro/nanofiber enabled tactile sensors and soft actuators: A review
  • Lei Zhang, Yuqi Zhen, Limin Tong
  • Opto-Electronic Science
  • 2024-07-26
  • Soliton microcomb generation by cavity polygon modes
  • Botao Fu, Renhong Gao, Ni Yao, Haisu Zhang, Chuntao Li, Jintian Lin, Min Wang, Lingling Qiao, Ya Cheng
  • Opto-Electronic Advances
  • 2024-07-25
  • Focus control of wide-angle metalens based on digitally encoded metasurface
  • Yi Chen, Simeng Zhang, Ying Tian, Chenxia Li, Wenlong Huang, Yixin Liu, Yongxing Jin, Bo Fang, Zhi Hong, Xufeng Jing
  • Opto-Electronic Advances
  • 2024-07-23
  • Spin-controlled generation of a complete polarization set with randomly-interleaved plasmonic metasurfaces
  • Sören im Sande, Yadong Deng, Sergey I. Bozhevolnyi, Fei Ding
  • Opto-Electronic Advances
  • 2024-07-23
  • An inversely designed integrated spectrometer with reconfigurable performance and ultra-low power consumption
  • Ang Li, Yifan Wu, Chang Wang, Feixia Bao, Zongyin Yang, Shilong Pan
  • Opto-Electronic Advances
  • 2024-07-17
  • OptoGPT: A foundation model for inverse design in optical multilayer thin film structures
  • Taigao Ma, Haozhu Wang, L. Jay Guo
  • Opto-Electronic Advances
  • 2024-07-10
  • Paving continuous heat dissipation pathways for quantum dots in polymer with orange-inspired radially aligned UHMWPE fibers
  • Xuan Yang, Xinfeng Zhang, Tianxu Zhang, Linyi Xiang, Bin Xie, Xiaobing Luo
  • Opto-Electronic Advances
  • 2024-07-05
  • Multiplexed stimulated emission depletion nanoscopy (mSTED) for 5-color live-cell long-term imaging of organelle interactome
  • Yuran Huang, Zhimin Zhang, Wenli Tao, Yunfei Wei, Liang Xu, Wenwen Gong, Jiaqiang Zhou, Liangcai Cao, Yong Liu, Yubing Han, Cuifang Kuang, Xu Liu
  • Opto-Electronic Advances
  • 2024-07-05



  • Image Cropping Assisted By Modeling Inter-Patch Relations                                Deep Snapshot Hdr Reconstruction Based On The Polarization Camera
    About
    |
    Contact
    |
    Copyright © PubCard