Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for OpenDAL for store #258

Open
prabirshrestha opened this issue Aug 26, 2024 · 2 comments
Open

Add support for OpenDAL for store #258

prabirshrestha opened this issue Aug 26, 2024 · 2 comments

Comments

@prabirshrestha
Copy link

Would be great if Apache OpenDAL is supported by for Store. It supports tons of file systems include s3 and would make it easy to use other filesystems besides s3. you can find the list of supported filesystems at https://docs.rs/opendal/latest/opendal/services/index.html.

@paulgb
Copy link
Member

paulgb commented Aug 26, 2024

Neat, I'll look into this. I imagine that any non-S3 backend would have to be something that Y-Sweet explicitly exposed through the binary (unless it were embedded into another server as a library); is there a backend that OpenDAL would enable that you are interested in in particular?

I'm also planning to evaluate slatedb.io as a storage layer, and it happens that slatedb uses the object_store crate which abstracts over storage backends. I see that OpenDAL has an object_store integration, so maybe that's a path here.

@prabirshrestha
Copy link
Author

I'm primarily looking for the SurrealDB integration. Internally it supports in memory, rocksdb, tikv and foundation db.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants