repo init

README.md

@@ -1 +1,119 @@
-# General-World-Models-Survey
+
+
+# [Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyond](https://arxiv.org/abs/TODO) [![Awesome](https://cdn.rawgit.com/sindresorhus/awesome/d7305f38d29fed78fa85652e3a63e154dd8e8829/media/badge.svg)](https://github.com/sindresorhus/awesome)  [![arXiv](https://img.shields.io/badge/arXiv-b31b1b.svg)](https://arxiv.org/abs/TODO) 
+
+
+<div style="text-align:center; font-size: 18px;">
+    <p>
+    <a href="https://scholar.google.com/citations?user=NmwjI0AAAAAJ&hl=en">Zheng Zhu*</a>, 
+    <a href="https://scholar.google.com/citations?user=NmwjI0AAAAAJ&hl=en">Xiaofeng Wang*</a>,
+    <a href="https://scholar.google.co.jp/citations?user=aocj89kAAAAJ&hl=es">Wangbo Zhao*</a>,
+    <a href="https://scholar.google.com/citations?user=pE9gTMQAAAAJ&hl=zh-CN">Min Chen*</a>,
+    <a href="">Nianchen Deng*</a>,
+    <a href="https://scholar.google.com.hk/citations?hl=zh-CN&user=w9fTWKQAAAAJ">Min Dou*</a>,
+    <a href="https://scholar.google.com/citations?user=35UcX9sAAAAJ&hl=en">Yuqi Wang*</a>,
+    <a href="https://scholar.google.com.hk/citations?hl=zh-CN&user=K0PpvLkAAAAJ">Botian Shi<sup>#</sup></a>,
+    <a href="https://scholar.google.com/citations?user=i2II0XIAAAAJ&hl=en">Kai Wang<sup>#</sup</a>,
+    <a href="https://scholar.google.com/citations?user=aTA2wL4AAAAJ&hl=en">Chi Zhang<sup>#</sup</a>,
+    <a href="">Yang You<sup>#</sup</a>,
+    <a href="https://scholar.google.com/citations?user=qxWfV6cAAAAJ&hl=en">Zhaoxiang Zhang<sup>#</sup</a>,
+    <a href="">Dawei Zhao<sup>#</sup</a>,
+    <a href="https://scholar.google.com/citations?user=hvxSnzoAAAAJ&hl=lt">Liang Xiao<sup>#</sup</a>,
+    <a href="https://scholar.google.com.sg/citations?hl=en&user=zdhRJCkAAAAJ&view_op=list_works&gmla=AJsN-F4PURIx5GMQHVpprJJBjTsNC62YCHjxGsKOwVhrkZ1aJsLgBiuKPBbAgbdcE5_KNw3OnLQgOVSjlqmS6gc-6ti0M2K5o-klHgoOywFCbdaaGnpis130zvgoZFJkVfmoNKpo8Krp">Jian Zhao<sup>#</sup</a>,
+    <a href="https://scholar.google.com/citations?user=TN8uDQoAAAAJ&hl=en">Jiwen Lu<sup>#</sup</a>,
+    <a href="">Guan Huang<sup>#</sup</a>
+</div>
+
+<div style="text-align:center; font-size: 18px;">
+    <p>
+    (* denotes equal contributions,  <sup>#</sup> denotes corresponding authors)
+</div>
+
+
+
+
+
+<p align="center">
+<img src="asset/videogen.gif" width="320px"/>  
+<img src="asset/videogen2.gif" width="320px"/>  
+</p>
+
+
+<p align="center">
+<img src="asset/drivedreamer.gif" width="190px"/>
+<img src="asset/drive-wm.gif" width="450px"/>
+</p>
+
+
+
+<p align="center">
+<img src="asset/drive.gif" width="640px"/>
+</p>
+
+<p align="center">
+<img src="asset/unisim.gif" width="240px"/>
+<img src="asset/unipi.gif" width="245px"/>    
+<img src="asset/robodreamer.gif" width="145px"/>    
+</p>
+
+
+
+<p align="center">
+(Source: <a href="https://universal-simulator.github.io/unisim/">UniSim</a>, <a href="https://universal-policy.github.io/unipi/">UniPi</a>, <a href="https://robovideo.github.io/">RoboDreamer</a>, <a href="https://openai.com/sora">Sora</a>, <a href="https://drivedreamer.github.io/">DriveDreamer</a>, <a href="https://drivedreamer2.github.io/">DriveDreamer-2</a>, <a href="https://drive-wm.github.io/">Drive-WM</a>)
+</p>
+
+
+<!-- - [News] <span style="color:red;"> **We are planning to update the survey soon to encompass the latest work. If you have any suggestions, please feel free to contact us.**</span>
+- [News] The Chinese translation is available on [Zhihu](https://zhuanlan.zhihu.com/p/661860981). Special thanks to [Dai-Wenxun](https://github.com/Dai-Wenxun) for this.
+ -->
+
+
+This is the official repository for the technical report: 
+
+**Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyond**.
+
+
+## 📌 Introduction
+
+In our report, we present a holistic examination of recent advancements in world model research, encompassing profound philosophical perspectives and detailed discussions. Our analysis delves deeply into the literature surrounding world models for **video generation**, **autonomous driving**, and **autonomous agents**, uncovering their applications in media production, artistic expression, end-to-end driving, games, and robots. We assess the existing challenges and limitations of world models and delve into prospective avenues for future research, with the intention of steering and igniting further progress in world models.
+
+![Framework](./asset/Framework.png "Framework of general world models")
+
+## Papers and Toolboxes for Video Generation World Models 
+![VideoGen](./asset/VideoGen.png "video generation world models")
+
+| Methods | Task | Github|
+|:-----:|:-----:|:-----:|
+| [Open-Sora-Plan](https://github.com/PKU-YuanGroup/Open-Sora-Plan/blob/main/docs/Report-v1.0.0.md)  | T2V Generation | [![Star](https://img.shields.io/github/stars/PKU-YuanGroup/Open-Sora-Plan.svg?style=social&label=Star)](https://github.com/PKU-YuanGroup/Open-Sora-Plan)|
+| [Open-Sora](https://github.com/hpcaitech/Open-Sora/blob/main/docs/zh_CN/README.md)  | T2V Generation | [![Star](https://img.shields.io/github/stars/hpcaitech/Open-Sora.svg?style=social&label=Star)](https://github.com/hpcaitech/Open-Sora)|
+| [Sora](https://openai.com/sora)  | T2V Generation & Editing | -|
+
+
+## Papers and Toolboxes for Autonomous Driving World Models 
+![Drive](./asset/Drive.png "autonomous driving world models")
+
+| Methods | Task | Github|
+|:-----:|:-----:|:-----:|
+| [Sora](https://openai.com/sora)  | T2V Generation & Editing | -|
+
+
+
+## Papers and Toolboxes for Autonomous Agents World Models 
+![Agent](./asset/Agent.png "autonomous agents world models")
+
+| Methods | Task | Github|
+|:-----:|:-----:|:-----:|
+| [Sora](https://openai.com/sora)  | T2V Generation & Editing | -|
+
+
+## Contact
+If you find our survey is useful in your research or applications, please consider giving us a star 🌟 and citing it by the following BibTeX entry.
+
+```
+@article{generalworldmodelsurvey,
+  title={Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyond},
+  author={Zheng Zhu and Xiaofeng Wang and Wangbo Zhao and Min Chen and Nianchen Deng and Min Dou and Yuqi Wang and Botian Shi and Kai Wang and Chi Zhang and Yang You and Zhaoxiang Zhang and Dawei Zhao and Liang Xiao and Jian Zhao and Jiwen Lu and Guan Huang}, 
+  journal={arXiv preprint arXiv:TODO},
+  year={2024}
+}
+```