add more notebooks

sigvt · Jul 4, 2022 · a28598e · a28598e
1 parent 281fd7e
commit a28598e
Show file tree

Hide file tree

Showing 17 changed files with 475,618 additions and 2,919 deletions.
diff --git a/.env.example b/.env.example
@@ -0,0 +1,8 @@
+MONGODB_URI=mongodb://localhost:27017/honeybee
+ANONYMIZATION_SALT=supersecret
+CURRENCY_API_KEY=
+
+RAW_DATA_DIR=./data/raw
+VTLC_DIR=./data/vtlc
+VTLC_ELEMENTS_DIR=./data/vtlc-elements
+VTLC_COMPLETE_DIR=./data/vtlc-complete
diff --git a/.env.placeholder b/.env.placeholder
diff --git a/.gitignore b/.gitignore
@@ -5,6 +5,7 @@
 /tmp
 /*.ipynb
 TODO
+node_modules
 
 # Created by https://www.toptal.com/developers/gitignore/api/python
 # Edit at https://www.toptal.com/developers/gitignore?templates=python

diff --git a/README.md b/README.md
@@ -4,7 +4,7 @@
 
 **VTuber 1B** is an academic purpose NLP dataset, collecting over a billion live chats, superchats, and moderation events (bans/deletions) from virtual YouTubers' live streams.
 
-Download the dataset from [Kaggle Datasets](https://www.kaggle.com/uetchy/vtuber-livechat) and join `#livechat-dataset` channel on [holodata Discord](https://holodata.org/discord) for discussions.
+Download the dataset from [Kaggle Datasets](https://www.kaggle.com/uetchy/vtuber-livechat) and join `#vtuber-1b` channel on [holodata Discord](https://holodata.org/discord) for discussions.
 
 > We also offer [❤️‍🩹 Sensai](https://github.com/holodata/sensai-dataset), a live chat dataset specifically made for building ML models for spam detection / toxic chat classification.
 
@@ -30,7 +30,7 @@ Download the dataset from [Kaggle Datasets](https://www.kaggle.com/uetchy/vtuber
 - Superchat Analysis
 - Training neural language models
 
-See public notebooks built on [VTuber 1B](https://www.kaggle.com/uetchy/vtuber-livechat/code) and [VTuber 1B Elements](https://www.kaggle.com/uetchy/vtuber-livechat-elements/code) for ideas.
+See Kaggle public notebooks ([VTuber 1B](https://www.kaggle.com/uetchy/vtuber-livechat/code) / [VTuber 1B Elements](https://www.kaggle.com/uetchy/vtuber-livechat-elements/code)) for ideas, as well as [`/notebooks`](./notebooks) folder in the repo.
 
 > We employed [Honeybee](https://github.com/holodata/honeybee) cluster to collect real-time live chat events across major Vtubers' live streams. All sensitive data such as author name or author profile image are omitted from the dataset, and author channel id is anonymized by SHA-1 hashing algorithm with a grain of salt.
 

diff --git a/notebooks/hololive-insights.ipynb b/notebooks/hololive-insights.ipynb
diff --git a/notebooks/img/fanatics.png b/notebooks/img/fanatics.png
diff --git a/notebooks/img/overlaps_by_groups.png b/notebooks/img/overlaps_by_groups.png
diff --git a/notebooks/img/overlaps_by_sector.png b/notebooks/img/overlaps_by_sector.png
diff --git a/notebooks/livechat-population.ipynb b/notebooks/livechat-population.ipynb
diff --git a/notebooks/livechat_population.ipynb b/notebooks/livechat_population.ipynb