Skip to content

Latest commit

 

History

History
72 lines (47 loc) · 2.47 KB

File metadata and controls

72 lines (47 loc) · 2.47 KB

Scrape Twitter JSON to HTML Table


This script shows how to scrape your tweets by date or year using the opensource project Twint and turn it into a beautiful HTML table. No API key is required..


Twint: https://github.com/twintproject/twint

json2html: https://github.com/softvar/json2html


Video Usage Instructions on Awesome Dev Notes YouTube: https://youtu.be/042-QIhC5ms


Twitter Badge androiddevnotes GitHub badge


twint awesomedevnotes - androiddevnotes youtube thumbnail


filter.py: To filter out the JSON nodes. You can modify the script to remove the JSON data that is not required or add the ones you need.

jsonhtml.py: To convert the JSON data to HTML table. You don't need to modify this script to work.


Installing Twint

Make sure you have python and pip installed.

pip3 install --user --upgrade git+https://github.com/twintproject/twint.git@origin/master#egg=twint

Run Twint

Parameters are explained in the video or go to wiki

twint -u androiddevnotes --since 2020-05-20 --until 2021-03-01 -o twint_androiddevnotes.json --json

The output will be JSON data.

Watch the Video to see how to turn the above scraped Twitter JSON data to HTML table.

The video shows the usage of filter.py and jsonhtml.py


💻 Find us on