httpreserve suite

All

16 repositories

linkscanner
Public
A helper package to tokenize textual content and retrieve hyperlinks
archives code4lib webarchiving digitalpreservation documentary-heritage httpreserve
Go
•
GNU General Public License v3.0
•0•3•0•0•Updated Nov 7, 2024Nov 7, 2024
tikalinkextract
Public
Tika based link (URL) extractor for httpreserve
tika archives code4lib webarchiving digitalpreservation httpreserve tika-wrapper iipc url-extractor
HTML
•1•9•7•1•Updated Nov 7, 2024Nov 7, 2024
awesome-web-archiving
Public
An Awesome List for getting started with web archiving
Creative Commons Zero v1.0 Universal
•156•2•0•0•Updated Dec 4, 2023Dec 4, 2023
linkstat
Public
CLI implementation of httpreserve that can test links and retrieve internet archive replacements
link-checker cli archives internet-archive web-archiving wayback-machine glam code4lib digital-preservation digipres
Go
•
GNU General Public License v3.0
•0•9•1•0•Updated Aug 29, 2023Aug 29, 2023
httpreserve
Public
Digital Preservation of HTTP in documentary heritage.
archives code4lib wayback internetarchive digipres webarchiving digitalpreservation documentary-heritage digital-repositories waybackmachine
Go
•
GNU General Public License v3.0
•3•22•13•0•Updated May 26, 2023May 26, 2023
workbench
Public
Client app for httpreserve pkg that generates CSV, JSON, HTTP, and BoltDB
archives boltdb code4lib internetarchive webarchiving digitalpreservation digital-repositories
JavaScript
•
GNU General Public License v3.0
•0•2•4•0•Updated May 26, 2023May 26, 2023
urlgetter
Public
Script to disambiguate domain names from where they actually point to.
Python
•
GNU General Public License v3.0
•0•0•0•0•Updated May 9, 2023May 9, 2023
simplerequest
Public
Minimal HTTP requests for Golang
httprequest httphandler golang
Go
•
GNU General Public License v3.0
•0•0•1•0•Updated Apr 20, 2023Apr 20, 2023
conventoarchiver
Public
Repository for collecting scripts to help capture MyConvento newsroom press-releases from the MyConvento PR management suite. The README provides an analysis of the MyConvento URL architecture for users hoping to develop a solution for themselves.
internet-archive web-archiving digipres webarchives internet-archiving press-releases myconvento pr-newsroom my-convento
Python
•
GNU General Public License v3.0
•0•1•0•0•Updated Jan 5, 2022Jan 5, 2022
wayback
Public
A restrictied API in Golang for the (semi)-exposed functions of the internet archive.
archives code4lib internetarchive webarchiving digitalpreservation
Go
•
GNU General Public License v3.0
•0•1•0•0•Updated Dec 22, 2021Dec 22, 2021
mementoqa
Public
QA Mementos using Screenshots
memento web-archiving wayback-machine code4lib digital-preservation
HTML
•
GNU General Public License v3.0
•0•0•3•0•Updated Jun 16, 2021Jun 16, 2021
eaccession-research
Public
A repository to store data associated with HTTPreserve research on Archive NZ's born digital material.
0•0•0•0•Updated Jun 2, 2021Jun 2, 2021
gnomescreenshot
Public
Wrapper for gnome-web-photo for httpreserve demos
Go
•
GNU General Public License v3.0
•0•0•0•0•Updated Jun 2, 2021Jun 2, 2021
wadl-2017
Public
Resources for WADL 2017
wadl web-archiving code4lib digital-preservation httpreserve jcdl
0•0•0•0•Updated Jun 2, 2021Jun 2, 2021
phantomjsscreenshot
Public
A wrapper for phantom.js commands for headless screenshots.
code4lib webarchiving digitalpreservation websnapshot httpreserve
Go
•
GNU General Public License v3.0
•0•1•0•0•Updated Jun 2, 2021Jun 2, 2021
million-dollar-webpage
Public
HTTPreserve Analysis of Million Dollar Web Page
digital-humanities web-archiving code4lib harvard webarchiving computing-history boingboing
2•0•0•0•Updated Jun 2, 2021Jun 2, 2021