Year
Month
(Peer-Reviewed) DRVI: Dual Refinement for Video Interpolation
Xuanyi Wu ¹, Zhenkun Zhou 周振坤 ², Anup Basu ¹
¹ Department of Computing Science, University of Alberta, Edmonton, AB T6G 2R3, Canada
² Huawei Fields Laboratory, Hangzhou, Zhejiang 310000, China
IEEE Access, 2021-08-13
Abstract

The quality of a video clip is considered to be poor if the resolution or the frame rate is low. Video interpolation is thus introduced to enhance video quality and provide a better viewing experience to users. However, there are still some challenges, like the blur caused by motion changes.

In this paper, we introduce a dual refinement technique for video interpolation (DRVI). It has three main steps, namely flow refinement, frame synthesis, and Haar refinement. The flow refinement can generate accurate bi-directional flows, which are more suitable for frame interpolation tasks. The Haar refinement uses the Discrete Wavelet Transform (DWT). It can preserve information in different frequency domains and also speed up the learning process. We also add an arbitrary time approximation module to allow multi-frame generation.

The number of learnable parameters in our model is much less than existing methods; still, it has excellent performance. Our method is trained on Vimeo90K (Xue et al. , 2019) and tested on three well-known datasets to demonstrate its effectiveness.
DRVI: Dual Refinement for Video Interpolation_1
DRVI: Dual Refinement for Video Interpolation_2
DRVI: Dual Refinement for Video Interpolation_3
  • Three-dimensional multichannel waveguide grating filters
  • Si-Yu Yin, Qi Guo, Shan-Ren Liu, Ju-Wei He, Yong-Sen Yu, Zhen-Nan Tian, Qi-Dai Chen
  • Opto-Electronic Science
  • 2024-08-14
  • Ka-Band metalens antenna empowered by physics-assisted particle swarm optimization (PA-PSO) algorithm
  • Shibin Jiang, Wenjun Deng, Zhanshan Wang, Xinbin Cheng, Din Ping Tsai, Yuzhi Shi, Weiming Zhu
  • Opto-Electronic Science
  • 2024-07-26
  • Complete-basis-reprogrammable coding metasurface for generating dynamically-controlled holograms under arbitrary polarization states
  • Zuntian Chu, Xinqi Cai, Ruichao Zhu, Tonghao Liu, Huiting Sun, Tiefu Li, Yuxiang Jia, Yajuan Han, Shaobo Qu, Jiafu Wang
  • Opto-Electronic Advances
  • 2024-07-26
  • Optical micro/nanofiber enabled tactile sensors and soft actuators: A review
  • Lei Zhang, Yuqi Zhen, Limin Tong
  • Opto-Electronic Science
  • 2024-07-26
  • Soliton microcomb generation by cavity polygon modes
  • Botao Fu, Renhong Gao, Ni Yao, Haisu Zhang, Chuntao Li, Jintian Lin, Min Wang, Lingling Qiao, Ya Cheng
  • Opto-Electronic Advances
  • 2024-07-25
  • Focus control of wide-angle metalens based on digitally encoded metasurface
  • Yi Chen, Simeng Zhang, Ying Tian, Chenxia Li, Wenlong Huang, Yixin Liu, Yongxing Jin, Bo Fang, Zhi Hong, Xufeng Jing
  • Opto-Electronic Advances
  • 2024-07-23
  • Spin-controlled generation of a complete polarization set with randomly-interleaved plasmonic metasurfaces
  • Sören im Sande, Yadong Deng, Sergey I. Bozhevolnyi, Fei Ding
  • Opto-Electronic Advances
  • 2024-07-23
  • An inversely designed integrated spectrometer with reconfigurable performance and ultra-low power consumption
  • Ang Li, Yifan Wu, Chang Wang, Feixia Bao, Zongyin Yang, Shilong Pan
  • Opto-Electronic Advances
  • 2024-07-17
  • OptoGPT: A foundation model for inverse design in optical multilayer thin film structures
  • Taigao Ma, Haozhu Wang, L. Jay Guo
  • Opto-Electronic Advances
  • 2024-07-10
  • Paving continuous heat dissipation pathways for quantum dots in polymer with orange-inspired radially aligned UHMWPE fibers
  • Xuan Yang, Xinfeng Zhang, Tianxu Zhang, Linyi Xiang, Bin Xie, Xiaobing Luo
  • Opto-Electronic Advances
  • 2024-07-05
  • Multiplexed stimulated emission depletion nanoscopy (mSTED) for 5-color live-cell long-term imaging of organelle interactome
  • Yuran Huang, Zhimin Zhang, Wenli Tao, Yunfei Wei, Liang Xu, Wenwen Gong, Jiaqiang Zhou, Liangcai Cao, Yong Liu, Yubing Han, Cuifang Kuang, Xu Liu
  • Opto-Electronic Advances
  • 2024-07-05



  • Successful New-entry Prediction for Multi-Party Online Conversations via Latent Topics and Discourse Modeling                                Distributed Expectation Propagation Detection for Cell-Free Massive MIMO
    About
    |
    Contact
    |
    Copyright © PubCard