Skip to content

Latest commit

 

History

History
109 lines (84 loc) · 10.3 KB

Awesome-BEV-Perception-Multi-Cameras.md

File metadata and controls

109 lines (84 loc) · 10.3 KB
Raw

Awesome BEV Perception from Multi-Cameras

ECCV 2020

  • LSS: Lift, Splat, Shoot: Encoding Images from Arbitrary Camera Rigs by Implicitly Unprojecting to 3D [paper] [Github]

CoRL 2021

  • DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queries [paper] [Github]

CVPR 2021

  • CaDDN:Categorical Depth Distribution Network for Monocular 3D Object Detection [paper] [Github]

ICCV 2021

  • FIERY: Future Instance Prediction in Bird's-Eye View from Surround Monocular Cameras [paper] [Github]

CVPR 2022

  • CVT: Cross-view Transformers for real-time Map-view Semantic Segmentation [paper] [Github]

ICRA 2022

ACMM 2022

  • Graph-DETR3D: Rethinking Overlapping Regions for Multi-View 3D Object Detection [paper]

ECCV 2022

  • BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformers [paper] [Github]
  • PETR: Position Embedding Transformation for Multi-View 3D Object Detection [paper][Github]
  • SpatialDETR: Robust Scalable Transformer-Based 3D Object Detection from Multi-View Camera Images with Global Cross-Sensor Attention[paper] [Github]

2022

  • BEVDet: High-Performance Multi-Camera 3D Object Detection in Bird-Eye-View [paper] [Github]
  • BEVDet4D: Exploit Temporal Cues in Multi-camera 3D Object Detection [paper]
  • PETRv2: A Unified Framework for 3D Perception from Multi-Camera Images [paper][Github]
  • Sparse4D [paper][Github][video]
  • M2BEV: Multi-Camera Joint 3D Detection and Segmentation with Unified Birds-Eye View Representation [paper]
  • BEVerse: Unified Perception and Prediction in Birds-Eye-View for Vision-Centric Autonomous Driving [paper] [Github]
  • PolarDETR: Polar Parametrization for Vision-based Surround-View 3D Detection[paper] [Github]
  • (CoRL 2022) LaRa: Latents and Rays for Multi-Camera Bird's-Eye-View Semantic Segmentation [paper] [Github]
  • (AAAI 2023) PolarFormer: Multi-camera 3D Object Detection with Polar Transformers[paper] [Github]
  • (ICRA 2023) CrossDTR: Cross-view and Depth-guided Transformers for 3D Object Detection[paper] [Github]
  • (AAAI 2023) BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detection [paper][Github]
  • A Simple Baseline for BEV Perception Without LiDAR [paper] [Github]
  • BEVFormer v2: Adapting Modern Image Backbones to Bird's-Eye-View Recognition via Perspective Supervision [paper]
  • AeDet: Azimuth-invariant Multi-view 3D Object Detection [paper] [Github
  • (WACV 2023) BEVSegFormer: Bird’s Eye View Semantic Segmentation From Arbitrary Camera Rigs [paper]

Longterm BEV

  • Time Will Tell: New Outlooks and A Baseline for Temporal Multi-View 3D Object Detection [paper][Github]
  • VideoBEV: Exploring Recurrent Long-term Temporal Fusion for Multi-view 3D Perception [paper]
  • HoP: Temporal Enhanced Training of Multi-view 3D Object Detector via Historical Object Prediction [paper]
  • StreamPETR: Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detection [paper][Github]
  • SparseBEV: High-Performance Sparse 3D Object Detection from Multi-Camera Videos [paper][Github]

BEV + Stereo

  • (AAAI 2023) BEVStereo: Enhancing Depth Estimation in Multi-view 3D Object Detection with Dynamic Temporal Stereo [paper] [Github]
  • STS: Surround-view Temporal Stereo for Multi-view 3D Detection [paper]

End to End BEV Perception

  • ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learning [paper][Github]
  • UniAD: Planning-oriented Autonomous Driving [paper][Github]

BEV + Distillation

  • (ICLR 2023) BEVDistill: Cross-Modal BEV Distillation for Multi-View 3D Object Detection [paper] [Github]
  • TiG-BEV: Multi-view BEV 3D Object Detection via Target Inner-Geometry Learning [paper][Github]

Robust BEV

  • RoboBEV: Towards Robust Bird's Eye View Detection under Corruptions [paper] [Github]

Fast BEV

HD Map Construction

  • (ICRA 2022) HDMapNet: An Online HD Map Construction and Evaluation Framework [paper] [Github]
  • (ICLR 2023) MapTR: Structured Modeling and Learning for Online Vectorized HD Map Construction [paper] [Github]

Multi-sensor fusion

  • FUTR3D: A Unified Sensor Fusion Framework for 3D Detection [paper] [Github]
  • (NeurIPS 2022) BEVFusion: A Simple and Robust LiDAR-Camera Fusion Framework [paper] [Github]
  • (NeurIPS 2022) Unifying Voxel-based Representation with Transformer for 3D Object Detection [paper] [Github]
  • BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representation [paper] [Github]
  • CMT: Cross Modal Transformer via Coordinates Encoding for 3D Object Dectection [paper] [Github]
  • BEVFusion4D: Learning LiDAR-Camera Fusion Under Bird's-Eye-View via Cross-Modality Guidance and Temporal Aggregation [paper]

Survey

  • Vision-Centric BEV Perception: A Survey [paper] [Github]
  • Delving into the Devils of Bird's-eye-view Perception: A Review, Evaluation and Recipe [paper][Github]

Occupancy Network

  • TPVFormer: An academic alternative to Tesla's Occupancy Network [Github]

Pre-training

  • UniWorld: Autonomous Driving Pre-training via World Models [paper][github]
  • Occ-BEV: Multi-Camera Unified Pre-training via 3D Scene Reconstruction [paper][Github]
  • Occupancy-MAE: Self-supervised Pre-training Large-scale LiDAR Point Clouds with Masked Occupancy Autoencoders [paper][Github]

others

  • Focal Sparse Convolutional Networks for 3D Object Detection [paper] [Github]
  • Voxel Field Fusion for 3D Object Detection [paper] [Github]
  • Scaling up Kernels in 3D CNNs [paper] [Github]

nuScenes detection task Leaderboard