This repo is a wrapper around the Lahnman database to convert the data into a DuckDB database for fast, local, offline analytics.
As of March 31, 2022 this requires the bleeding edge version of DuckDB to work because of the very recently added foreign key support.
You can either run: pip install duckdb --pre --upgrade
Or pip install -r requirements.txt
https://duckdb.org/docs/installation/
cd to src and run $ python main.py to regenerate the lahnman.duckdb database file
The Lahnman Baseball Database was created by Sean Lahnman and is maintained by the Chadwick Baseball Bureau as the baseballdatabank project on GitHub. It contains baseball data.
DuckDB is an in-process SQL OLAP database management system
OLAP = Online analytical processing
The Lahnman database is currently distributed in three formats: MS Access database, SQLite database, and CSV. SQLite is a good simple database solution but DuckDB is specifically optimized for analytics while maintaining the same single file database format as SQLite.
In other words, even though it is still under development, DuckDB is a good drop-in replacement for SQLite for this use case.
The lahnman folder is the baseballdatabank repo as a submodule. None of the data in this module has been touched.
The sql folder contains create queries pulled from the Lahnman SQLite distribution. Some have been modified slightly to align with the data in the lahnman folders, for example some tables contained extraneous columns. Also a few tables without associated data were also dropped (leagues and divisions) along with index statements that referenced them.