September 2021 - Add phishtank support, improve monitoring, logging and cache

New features

• Integration with Phishtank via Phishtank Lookup - Documentation.

---

---

• Simple monitoring script to keep an eye on the health of the instance, run it in a tmux/screen with watch.

---

---

• Link in the tree menu to re-trigger a capture on the same URL.

Fixes

• Improve logging entries, the date was incomplete.
• Add UUID file in export.
• Inform users when a capture failed critically and we have nothing to show.
• Catch timeout when pushing to MISP (avoid exception)

Changes

• Major improvements in caching, better handling of exceptions and keep a limited amount of pickles in memory.
• Simplify code in the async capture script.
• Add urlscan.io permalink in MISP export
• Add phishtank permalink in MISP export
• Move modules to dedicated files