Year
Month
(Preprint) Instance Segmentation in 3D Scenes using Semantic Superpoint Tree Networks
Zhihao Liang ¹ ², Zhihao Li ³, Songcen Xu 许松岑 ³, Mingkui Tan 谭明奎 ¹, Kui Jia 贾奎 ¹ ⁴ ⁵
¹ South China University of Technology
华南理工大学
² DexForce Technology Co., Ltd.
跨维(广州)智能科技有限公司
³ Noah’s Ark Lab, Huawei Technologies
华为诺亚方舟实验室
⁴ Pazhou Laboratory
琶洲实验室 (人工智能与数字经济广东省实验室)
⁵ Peng Cheng Laboratory
鹏城实验室
arXiv, 2021-08-17
Abstract

Instance segmentation in 3D scenes is fundamental in many applications of scene understanding. It is yet challenging due to the compound factors of data irregularity and uncertainty in the numbers of instances. State-of-the-art methods largely rely on a general pipeline that first learns point-wise features discriminative at semantic and instance levels, followed by a separate step of point grouping for proposing object instances. While promising, they have the shortcomings that (1) the second step is not supervised by the main objective of instance segmentation, and (2) their point-wise feature learning and grouping are less effective to deal with data irregularities, possibly resulting in fragmented segmentations.

To address these issues, we propose in this work an end-to-end solution of Semantic Superpoint Tree Network (SSTNet) for proposing object instances from scene points. Key in SSTNet is an intermediate, semantic superpoint tree (SST), which is constructed based on the learned semantic features of superpoints, and which will be traversed and split at intermediate tree nodes for proposals of object instances. We also design in SSTNet a refinement module, termed CliqueNet, to prune superpoints that may be wrongly grouped into instance proposals.

Experiments on the benchmarks of ScanNet and S3DIS show the efficacy of our proposed method. At the time of submission, SSTNet ranks top on the ScanNet (V2) leaderboard, with 2% higher of mAP than the second best method.
Instance Segmentation in 3D Scenes using Semantic Superpoint Tree Networks_1
Instance Segmentation in 3D Scenes using Semantic Superpoint Tree Networks_2
Instance Segmentation in 3D Scenes using Semantic Superpoint Tree Networks_3
Instance Segmentation in 3D Scenes using Semantic Superpoint Tree Networks_4
  • Scaling metasurface design: from reusable unit cells to full-metasurface inverse design
  • Eunbi Jang, Jiwan Hong, Ho-Jun Lee, Seokju Choi, Hyewon Suk, Chanik Kang, Sunae So, Haejun Chung
  • Opto-Electronic Science
  • 2026-10-20
  • Ultrafast all-optical biomimetic encoder for spiking neural networks
  • Qijun Bian, Fangchen Hu, Junlian Jia, Aolong Sun, Sizhe Xing, Boyu Dong, An Yan, Ziwei Li, Jianyang Shi, Nan Chi, Junwen Zhang
  • Opto-Electronic Science
  • 2026-10-20
  • Windmill-shaped multi-unit piezoelectric ceramic tuning fork for cooperatively enhanced photoacoustic methane sensing
  • Botao Liu, Guowei Han, Runqiu Wang, Xuan Yang, Haiyue Sun, Shunda Qiao, Ying He, Angelo Sampaolo, Vincenzo Spagnolo, Yufei Ma
  • Opto-Electronic Science
  • 2026-10-20
  • Ultrafast laser direct writing of highly conductive copper micropatterns
  • Songyan Xue, Chunsan Deng, Mingduo Zhang, Huace Hu, Fayu Chen, Leimin Deng, Jianguo Liu, Hui Gao, Wei Xiong
  • Opto-Electronic Manufacturing
  • 2026-09-30
  • Recent advances in fiber-tip integration based on femtosecond laser 3D printing
  • Yuye Xuan, Dezhi Zhu, Dejun Liu, Ying Wang, Yiping Wang, Changrui Liao
  • Opto-Electronic Manufacturing
  • 2026-09-30
  • Neural holography enabled multi-beam steering for multi-task classifier
  • Lin Wu, Mian Wu, Zhen Li, Ying Qiu, Zichen Liu, Yongquan Zeng, Guozhen Liang, Hanbing Li, Guoxing Zheng, Zhixue He, Xi Xiao, Qi Jie Wang, Jin Tao, Shaohua Yu
  • Opto-Electronic Technology
  • 2026-09-30
  • Laser direct writing of nonlinear metasurfaces on phase-change material Ge₂Sb₂Te₅ for enhanced third harmonic generation
  • Lanpeng Guo, Haochong Liu, Shixin Gao, Ming Tang, Minghui Hong, Tun Cao
  • Opto-Electronic Technology
  • 2026-09-30
  • Nearly vertically emitted nonlinear light sources with high efficiencies enabled by high-Q nearly-degenerate polygon modes
  • Chuntao Li, Yingnuo Qiu, Renhong Gao, Lingling Qiao, Jielei Ni, Min Wang, Jintian Lin, Ya Cheng
  • Opto-Electronic Technology
  • 2026-09-30
  • Multiple degrees-of-freedom optical encryption via pixel-resolved vectorial holography
  • Jianzhong Peng, Haoxian Zhou, Mengzhe Shen, Dapeng Wang, Yu Chen, Renlong Zhang, Fangrui Lin, Xiaoyu Weng, Junle Qu
  • Opto-Electronic Technology
  • 2026-09-30
  • Recent progress on mid-infrared and terahertz dual-comb spectroscopy
  • Zhuoren Wan, Min Li, Binbin Liu, Yu Xia, Yuan Chen, Xiuxiu Zhang, Dongxu Zhu, Yan Dai, Sinan Tao, Hua Li, Ming Yan, Heping Zeng
  • Opto-Electronic Technology
  • 2026-09-30
  • Optical packaging of photonic integrated circuits: bottlenecks and potential solutions
  • Rodrigo Rendeiro, Hugo Neto, Diogo Vaz, Carla Rodrigues, Heming Wei, Jan Nedoma, Antonio Teixeira, Francisco Rodrigues, Carlos Marques
  • Opto-Electronic Technology
  • 2026-09-30



  • Integrated Sensing and Communications: Towards Dual-functional Wireless Networks for 6G and Beyond                                Successful New-entry Prediction for Multi-Party Online Conversations via Latent Topics and Discourse Modeling
    About
    |
    Contact
    |
    Copyright © PubCard