Skip to content

Streaming get with prefetch and Julia IO Stream API #30

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 14 commits into from
Feb 28, 2024
Merged

Streaming get with prefetch and Julia IO Stream API #30

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
d101657
Draft streaming get
andrebsguedes Feb 5, 2024
c0bbbf5
Uses read_get_stream interface instead of exposing the buffers to Julia
andrebsguedes Feb 7, 2024
326e3ff
Adds exports
andrebsguedes Feb 8, 2024
784532e
Adds put_object_stream and removes dependency on accurate object size…
andrebsguedes Feb 15, 2024
e772d13
Allows for anonymous reads on S3
andrebsguedes Feb 16, 2024
204f651
Improves error information
andrebsguedes Feb 23, 2024
3815c5f
Adds ParseURLError reason
andrebsguedes Feb 23, 2024
ab64504
Enables anonymous reads for Azure (plus error reason fix)
andrebsguedes Feb 23, 2024
7f607f3
Adds missing type
andrebsguedes Feb 23, 2024
2b4e70f
Accounts for DNS related connection errors
andrebsguedes Feb 23, 2024
6b7f502
Remove parameter that did not go through the object_store merge
andrebsguedes Feb 26, 2024
2cb3121
Handle early (before wait) response errors
andrebsguedes Feb 26, 2024
8f3b1a8
Always wait on AsyncCondition and check for response errors, fixes mi…
andrebsguedes Feb 27, 2024
53255c8
Bump object_store_ffi_jll to 0.5.0
andrebsguedes Feb 28, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 3 additions & 2 deletions Project.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,14 +16,15 @@ ReTestItems = "1"
Sockets = "1"
Test = "1"
julia = "1.8"
object_store_ffi_jll = "0.4.2"
object_store_ffi_jll = "0.5.0"

[extras]
CloudBase = "85eb1798-d7c4-4918-bb13-c944d38e27ed"
CodecZlib = "944b1d66-785c-5afd-91f1-9de20f533193"
HTTP = "cd3eb016-35fb-5094-929b-558a96fad6f3"
ReTestItems = "817f1d60-ba6b-4fd5-9520-3cf149f6a823"
Sockets = "6462fe0b-24de-5631-8697-dd941f90decc"
Test = "8dfed614-e22c-5e08-85e1-65c5234f0b40"

[targets]
test = ["CloudBase", "HTTP", "ReTestItems", "Sockets", "Test"]
test = ["CloudBase", "CodecZlib", "HTTP", "ReTestItems", "Sockets", "Test"]
Loading