Year
Month
(Preprint) GP-S3Net: Graph-based Panoptic Sparse Semantic Segmentation Network
Ryan Razani, Ran Cheng 程冉, Enxu Li, Ehsan Taghavi, Yuan Ren, Liu Bingbing
Huawei Noah’s Ark Lab, Toronto, Canada
arXiv, 2021-08-18
Abstract

Panoptic segmentation as an integrated task of both static environmental understanding and dynamic object identification, has recently begun to receive broad research interest. In this paper, we propose a new computationally efficient LiDAR based panoptic segmentation framework, called GP-S3Net.

GP-S3Net is a proposal-free approach in which no object proposals are needed to identify the objects in contrast to conventional two-stage panoptic systems, where a detection network is incorporated for capturing instance information. Our new design consists of a novel instance-level network to process the semantic results by constructing a graph convolutional network to identify objects (foreground), which later on are fused with the background classes. Through the fine-grained clusters of the foreground objects from the semantic segmentation backbone, over-segmentation priors are generated and subsequently processed by 3D sparse convolution to embed each cluster. Each cluster is treated as a node in the graph and its corresponding embedding is used as its node feature. Then a GCNN predicts whether edges exist between each cluster pair.

We utilize the instance label to generate ground truth edge labels for each constructed graph in order to supervise the learning. Extensive experiments demonstrate that GP-S3Net outperforms the current state-of-the-art approaches, by a significant margin across available datasets such as, nuScenes and SemanticPOSS, ranking first on the competitive public SemanticKITTI leaderboard upon publication.
GP-S3Net: Graph-based Panoptic Sparse Semantic Segmentation Network_1
GP-S3Net: Graph-based Panoptic Sparse Semantic Segmentation Network_2
GP-S3Net: Graph-based Panoptic Sparse Semantic Segmentation Network_3
GP-S3Net: Graph-based Panoptic Sparse Semantic Segmentation Network_4
  • High-resolution tumor marker detection based on microwave photonics demodulated dual wavelength fiber laser sensor
  • Jie Hu, Weihao Lin, Liyang Shao, Chenlong Xue, Fang Zhao, Dongrui Xiao, Yang Ran, Yue Meng, Panpan He, Zhiguang Yu, Jinna Chen, Perry Ping Shum
  • Opto-Electronic Advances
  • 2024-12-16
  • High performance laser induced plasma assisted ablation by GHz burst mode femtosecond pulses
  • Jingbo Yin, Yulong Zhao, Minghui Hong
  • Opto-Electronic Advances
  • 2024-12-16
  • Sequential harmonic spin–orbit angular momentum generation in nonlinear optical crystals
  • Yutao Tang, Zixian Hu, Junhong Deng, Kingfai Li, Guixin Li
  • Opto-Electronic Advances
  • 2024-12-16
  • Design, setup, and facilitation of the speckle structured illumination endoscopic system
  • Elizabeth Abraham, Zhaowei Liu
  • Opto-Electronic Science
  • 2024-12-13
  • Ultra-high-Q photonic crystal nanobeam cavity for etchless lithium niobate on insulator (LNOI) platform
  • Zhi Jiang, Cizhe Fang, Xu Ran, Yu Gao, Ruiqing Wang, Jianguo Wang, Danyang Yao, Xuetao Gan, Yan Liu, Yue Hao, Genquan Han
  • Opto-Electronic Advances
  • 2024-10-31
  • Advanced biological imaging techniques based on metasurfaces
  • Yongjae Jo, Hyemi Park, Hyeyoung Yoon, Inki Kim
  • Opto-Electronic Advances
  • 2024-10-31
  • Orthogonal matrix of polarization combinations: concept and application to multichannel holographic recording
  • Shujun Zheng, Jiaren Tan, Hongjie Liu, Xiao Lin, Yusuke Saita, Takanori Nomura, Xiaodi Tan
  • Opto-Electronic Advances
  • 2024-10-23
  • Streamlined photonic reservoir computer with augmented memory capabilities
  • Changdi Zhou, Yu Huang, Yigong Yang, Deyu Cai, Pei Zhou, Kuenyao Lau, Nianqiang Li, Xiaofeng Li
  • Opto-Electronic Advances
  • 2024-10-22
  • High-precision multi-focus laser sculpting of microstructured glass
  • Kang Xu, Peilin Huang, Lingyu Huang, Li Yao, Zongyao Li, Jiantao Chen, Li Zhang, Shaolin Xu
  • Opto-Electronic Advances
  • 2024-10-09
  • Multi-physical field null medium: new solutions for the simultaneous control of EM waves and heat flow
  • Sailing He, Ruili Zhang, Junbo Liang
  • Opto-Electronic Advances
  • 2024-09-30
  • Adaptive decentralized AI scheme for signal recognition of distributed sensor systems
  • Shixiong Zhang, Hao Li, Cunzheng Fan, Zhichao Zeng, Chao Xiong, Jie Wu, Zhijun Yan, Deming Liu, Qizhen Sun
  • Opto-Electronic Advances
  • 2024-09-29
  • Data-driven polarimetric approaches fuel computational imaging expansion
  • Sylvain Gigan
  • Opto-Electronic Advances
  • 2024-09-28



  • Deep Snapshot Hdr Reconstruction Based On The Polarization Camera                                Blind Estimation of Sparse Simo Channels: Quadratic Vs. Linear Constraints
    About
    |
    Contact
    |
    Copyright © PubCard