Skip to content

[NeurIPS 2022] 4D Unsupervised Object Discovery

Notifications You must be signed in to change notification settings

Robertwyq/LSMOL

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

13 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

4D Unsupervised Object Discovery

[NeurIPS 2022 Spotlight] 4D Unsupervised Object Discovery. Yuqi Wang, Yuntao Chen, Zhaoxiang Zhang

News

Catalog

The code is not available now, we will release it soon🚀

  • 3D Instance Segmentation
  • 2D Detection
  • NSPF for sceneflow estimation
  • 3D Instance Initialization Code
  • Data Processing Code
  • Initialization

Abstract

Object discovery is a core task in computer vision. While fast progresses have been made in supervised object detection, its unsupervised counterpart remains largely unexplored. With the growth of data volume, the expensive cost of annotations is the major limitation hindering further study. Therefore, discovering objects without annotations has great significance. However, this task seems impractical on still-image or point cloud alone due to the lack of discriminative information. Previous studies underlook the crucial temporal information and constraints naturally behind multi-modal inputs. In this paper, we propose 4D unsupervised object discovery, jointly discovering objects from 4D data -- 3D point clouds and 2D RGB images with temporal information. We present the first practical approach for this task by proposing a ClusterNet on 3D point clouds, which is jointly iteratively optimized with a 2D localization network. Extensive experiments on the large-scale Waymo Open Dataset suggest that the localization network and ClusterNet achieve competitive performance on both class-agnostic 2D object detection and 3D instance segmentation, bridging the gap between unsupervised methods and full supervised ones.

Methods

method

Visualization

vis

Get Started

Citation

Please consider citing our work as follows if it is helpful.

@article{wang20224d,
  title={4d unsupervised object discovery},
  author={Wang, Yuqi and Chen, Yuntao and ZHANG, ZHAO-XIANG},
  journal={Advances in Neural Information Processing Systems},
  volume={35},
  pages={35563--35575},
  year={2022}
}

Acknowledgement

Many thanks to the following open-source projects:

About

[NeurIPS 2022] 4D Unsupervised Object Discovery

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published