Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable the use of SQLite data sources from remote locations #39

Open
2 tasks done
d33bs opened this issue Apr 11, 2023 · 1 comment · May be fixed by #66
Open
2 tasks done

Enable the use of SQLite data sources from remote locations #39

d33bs opened this issue Apr 11, 2023 · 1 comment · May be fixed by #66

Comments

@d33bs
Copy link

d33bs commented Apr 11, 2023

What happens?

Hello - thank you so much for the work on sqlite_scanner, it's amazing to use this through DuckDB!

Would it be possible to use DuckDB to query SQLite files from remote locations? For example, it'd be stellar to query a SQLite file stored on AWS S3 using DuckDB queries. It seems like this could involve efforts from the httpfs extension. That said, please don't hesitate to let me know if it'd be more appropriate to add an issue elsewhere!

To Reproduce

Below is a Pythonic demonstration of what one might be able to do if this issue were addressed (building on the example sqlite_scan queries within the docs):

import duckdb

duckdb.connect().execute(
    """
    /* install and load sqlite plugin for duckdb */
    INSTALL sqlite_scanner;
    LOAD sqlite_scanner;
    
    /* perform query on film table */
    SELECT * FROM sqlite_scan('s3://bucket-name/sakila.db', 'film');
    """
)

OS:

MacOS

SQLite Version:

3.37.0

DuckDB Version:

0.7.1

DuckDB Client:

Python

Full Name:

Dave Bunten

Affiliation:

University of Colorado

Have you tried this on the latest master branch?

  • I agree

Have you tried the steps to reproduce? Do they include all relevant data and configuration? Does the issue you report still appear there?

  • I agree
@jlarmstrongiv
Copy link

Related duckdb/duckdb-wasm#1213

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants