Skip to content

Import object_store, with history, from arrow-rs #3

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 398 commits into from
Mar 20, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
398 commits
Select commit Hold shift + click to select a range
8cfb7e6
Prepare object_store 0.6.0 (#4241)
tustvold May 18, 2023
6eb2278
Fix merge conflict from #4220 (#4242)
tustvold May 18, 2023
f58f733
Set ECS specific metadata endpoint if AWS_CONTAINER_CREDENTIALS_RELAT…
jfuechsl May 26, 2023
9e5455c
feat: support bulk deletes in object_store (#4060)
wjones127 May 27, 2023
2dac010
feat: use exactly equal parts in multipart upload (#4305)
wjones127 May 30, 2023
9a8080c
Fix clippy for object_store (#4344)
tustvold Jun 2, 2023
5c11995
Don't exclude FIFO files from LocalFileSystem (#4345)
tustvold Jun 2, 2023
ce6affc
Fix support for ECS IAM credentials (#4310)
tustvold Jun 2, 2023
cd02568
Fix ObjectStore::get_range for GetResult::File (#4350) (#4351)
tustvold Jun 2, 2023
8d53456
Prepare object_store 0.6.1 (#4348)
tustvold Jun 2, 2023
f3576f8
gcp: Exclude authorization header when bearer empty (#4418)
vrongmeal Jun 20, 2023
61b9778
object_store/InMemory: Add `fork()` fn and deprecate `clone()` fn (#4…
Turbo87 Jul 10, 2023
094c8fb
ci: verify MSRV on CI (#4490)
eitsupi Jul 10, 2023
8e233d6
object_store: Implement `ObjectStore` for `Arc` (#4502)
Turbo87 Jul 10, 2023
3c24d42
object_store: Export `ClientConfigKey` and add `HttpBuilder::with_con…
thehabbos007 Jul 13, 2023
c9fbc53
Handle empty S3 payloads (#4514) (#4518)
tustvold Jul 14, 2023
c223796
Make object_store::multipart public (#4570)
yjshen Jul 26, 2023
ce017f6
Cleanup multipart upload trait (#4572)
tustvold Jul 27, 2023
850daa3
Use Config System for Object Store Integration Tests (#4628)
tustvold Aug 2, 2023
74dce2d
Support copy_if_not_exists for Cloudflare R2 (#4190) (#4239)
tustvold Aug 7, 2023
f15012c
Minor: improve object_store docs.rs library landing page (#4682)
alamb Aug 11, 2023
f8cc026
Check object_store format in CI (#4679)
tustvold Aug 11, 2023
1e71e94
Fix object_store docs and Add CI job (#4684)
alamb Aug 11, 2023
fd6887b
Faster stream_get test (#4685)
tustvold Aug 11, 2023
ad1d9da
Add Support for Microsoft Fabric / OneLake (#4573)
vmuddassir-msft Aug 11, 2023
02b5cff
Add AzureConfigKey::ContainerName (#4629) (#4686)
tustvold Aug 14, 2023
7a46cb4
Add range and ObjectMeta to GetResult (#4352) (#4495) (#4677)
tustvold Aug 14, 2023
40cc57a
Prepare object_store 0.7.0 (#4699)
tustvold Aug 15, 2023
74f4ffc
Update object_store Dependencies and Configure Dependabot (#4700)
tustvold Aug 16, 2023
944b91d
Fix new clippy lints (#4734)
tustvold Aug 24, 2023
7da7975
Add `with_proxy_ca_certificate` and `with_proxy_excludes` (#4714)
gordonwang0 Aug 25, 2023
1714a05
Update nix requirement from 0.26.1 to 0.27.1 in /object_store (#4744)
viirya Aug 28, 2023
6a163d6
Make ObjectStore::copy Atomic and Automatically Create Parent Directo…
tustvold Sep 2, 2023
775a469
Update object_store chrono deprecations (#4786)
tustvold Sep 7, 2023
c63f9e1
Make coalesce_ranges and collect_bytes available to the users (#4784)
sumerman Sep 7, 2023
67c44c2
Relaxing type bounds on coalesce_ranges and collect_bytes (#4787)
sumerman Sep 7, 2023
8ad9241
Best effort cleanup of staged upload files (#4778) (#4792)
tustvold Sep 8, 2023
f60ab24
ObjectStore Wasm32 Fixes (#4775) (#4776) (#4796)
tustvold Sep 14, 2023
af0a065
Update chrono pin (#4824)
tustvold Sep 17, 2023
33a92be
fix: object store http header last modified (#4834)
universalmind303 Sep 19, 2023
fb32443
Error if Remote Ignores HTTP Range Header (#4841)
universalmind303 Sep 20, 2023
dca6413
Perform HEAD request for HttpStore::head (#4837)
tustvold Sep 23, 2023
06d4f1d
Minor: Improve object_store docs.rs landing page (#4849)
alamb Sep 23, 2023
65f1e91
Allow overriding azure endpoint (#4853) (#4854)
tustvold Sep 25, 2023
690bf26
Add ObjectStore BufReader (#4762) (#4857)
tustvold Sep 25, 2023
549ada8
Prepare object_store 0.7.1 (#4860)
tustvold Sep 26, 2023
4e5d08b
Flush in multiple_append test (#4868) (#4869)
tustvold Sep 27, 2023
aeef1ad
Flush in creates_dir_if_not_present_append (#4872) (#4874)
tustvold Sep 28, 2023
cf99b75
Update ring requirement from 0.16 to 0.17 in /object_store (#4887)
dependabot[bot] Oct 2, 2023
a48c746
Upgrade to Rust 1.73.0 (#4899)
carols10cents Oct 6, 2023
2c55bf9
Cleanup `object_store::retry` client error handling (#4915)
tustvold Oct 11, 2023
2f3dde6
Add AWS presigned URL support (#4876)
carols10cents Oct 12, 2023
ac9bb17
Add GetOptions::head (#4931)
tustvold Oct 15, 2023
054faa6
Allow opting out of request signing (#4927) (#4929)
tustvold Oct 16, 2023
0272d06
Default connection and request timeouts of 5 seconds (#4928)
tustvold Oct 16, 2023
ceb1261
Support service_account in ApplicationDefaultCredentials and Use Self…
tustvold Oct 16, 2023
54270c7
Generate `ETag`s for `InMemory` and `LocalFileSystem` (#4879) (#4922)
tustvold Oct 17, 2023
4e11875
Remove Nested async and Fallibility from ObjectStore::list (#4930)
tustvold Oct 17, 2023
649ac0a
Fix object_store docs (#4947)
tustvold Oct 17, 2023
e0c9873
Return `PutResult` with an ETag from ObjectStore::put (#4934) (#4944)
tustvold Oct 19, 2023
82f893d
Split aws Module (#4953)
tustvold Oct 19, 2023
485422c
Split azure Module (#4954)
tustvold Oct 19, 2023
f5c696a
Add module links in docs root (#4955)
tustvold Oct 19, 2023
82bbdbe
Split gcp Module (#4956)
tustvold Oct 19, 2023
8c58e6d
Use rustfmt default line width (#4960)
tustvold Oct 19, 2023
08bf7df
Add ObjectMeta::version and GetOptions::version (#4925) (#4935)
tustvold Oct 20, 2023
97821ad
Support ImdsManagedIdentityProvider in Azure Functions (#4976) (#4977)
tustvold Oct 23, 2023
c339cc6
Update quick-xml requirement from 0.30.0 to 0.31.0 in /object_store (…
dependabot[bot] Oct 24, 2023
6e1f1c9
Increase default timeout to 30 seconds (#4989)
tustvold Oct 25, 2023
b5ef9d3
Add MultiPartStore (#4961) (#4608) (#4971)
tustvold Oct 25, 2023
9ec128c
Support bucket name with `.` when parsing GCS URL (#4991) (#4992)
tustvold Oct 26, 2023
356a8b3
Don't panic on invalid Azure access key (#4972) (#4974)
tustvold Oct 26, 2023
b45b838
Conditional Put (#4879) (#4984)
tustvold Oct 27, 2023
32450f0
Support list_with_offset for GCS (#4993)
tustvold Oct 30, 2023
1f3ac18
Object tagging (#4754) (#4999)
tustvold Oct 30, 2023
07d1d40
Improve object_store docs (#4978)
tustvold Oct 30, 2023
baebb66
Remove ObjectStore::append (#5016)
tustvold Nov 1, 2023
9beaee7
Decode URL paths (#5017) (#5018)
tustvold Nov 1, 2023
488159e
ObjectStore: make error msg thrown from retry more detailed (#5012)
Rachelint Nov 1, 2023
b8bc969
Relax path safety (#5019) (#5020)
tustvold Nov 2, 2023
7980d70
Support onelake fabric paths in parse_url (#5000) (#5002)
tustvold Nov 2, 2023
776b575
Prepare object_store 0.8.0 (#5010) (#5023)
tustvold Nov 2, 2023
8582f52
Verify object_store with all features (#5024)
tustvold Nov 2, 2023
76664be
Fix invalid_path test (#5026)
tustvold Nov 2, 2023
a9c17c6
refactor: change `object_store` CA handling (#5056)
crepererum Nov 8, 2023
cdc0151
docs: re-order `object_store` intro (#5058)
crepererum Nov 8, 2023
a5b670d
Add a PR under "Breaking changes" in the object_store 0.8.0 changelog…
carols10cents Nov 10, 2023
f2c6f26
Update itertools requirement from 0.11.0 to 0.12.0 in /object_store (…
dependabot[bot] Nov 15, 2023
ad8da1e
Fix latest clippy lints (#5090)
tustvold Nov 17, 2023
6f05363
Allow writing null valued keys in JSON (#5065)
Jefffrey Nov 20, 2023
2880860
Fix ObjectStore.LocalFileSystem.put_opts for blobfuse (#5094)
RobinLin666 Nov 27, 2023
33c220f
Update localstack to 3.0.1 (#5028)
tustvold Nov 28, 2023
f04eb5c
Allow 403 for overwrite prevention (#5134)
emcake Nov 29, 2023
baaf13b
object_store: fix failing doctest with default features (#5161)
Jefffrey Dec 5, 2023
6c99069
Update rustls-pemfile requirement from 1.0 to 2.0 in /object_store (#…
dependabot[bot] Dec 5, 2023
9c14bdc
feat(object_store): use http1 by default (#5204)
wjones127 Dec 12, 2023
0c4306d
Document default value of InstanceCredentialProvider (#5188)
justinabrahms Dec 23, 2023
3c4e95b
Remove deprecated try_with_option methods (#5237)
tustvold Dec 23, 2023
63a2d4f
Implement `copy_if_not_exist` for `AmazonS3` using DynamoDB (#4880) (…
tustvold Dec 26, 2023
ca756dc
Further Clippy Lints and Temporarily disable JS integration tests (#5…
tustvold Dec 29, 2023
d0da1ec
Default AWS region to us-east-1 (#5211) (#5244)
tustvold Dec 30, 2023
bedf624
docs(object_store): Mention `with_allow_http` in docs of `with_endpoi…
Xuanwo Jan 3, 2024
0c76a79
Fix ObjectMeta::size for range requests (#5272) (#5276)
tustvold Jan 3, 2024
b226208
Retry Safe/Read-Only Requests on Timeout (#5278)
tustvold Jan 4, 2024
ca790eb
feat(object_store): Azure url signing (#5259)
roeap Jan 4, 2024
88c6cf9
DynamoDB ConditionalPut (#5247)
tustvold Jan 4, 2024
a90a7a5
object_store: full HTTP range support (#5222)
clbarnes Jan 5, 2024
1d37757
Support S3 Express One Zone (#5268)
tustvold Jan 5, 2024
2550b97
Prepare object_store 0.9.0 (#5224) (#5285)
tustvold Jan 5, 2024
b29b274
refactor: log server error during object store retries (#5294)
crepererum Jan 11, 2024
d76b0c1
Remove localstack DynamoDB workaround (#5267) (#5307)
tustvold Jan 18, 2024
831ca26
Pass options to HTTPBuilder in parse_url_opts (#5310) (#5311)
tustvold Jan 19, 2024
cc5813c
Update IOx links (#5312)
tustvold Jan 19, 2024
0aec97f
Test parse_url_opts for HTTP (#5310) (#5316)
tustvold Jan 20, 2024
e5dfda3
Exclude questions from changelog (#5349)
tustvold Jan 30, 2024
025700d
docs(object-store): add warning to flush (#5369)
wjones127 Feb 7, 2024
33bcbe6
Pull container name from URL for Azure blob in https://<account>.blob…
bradvoth Feb 8, 2024
f10987d
[object_store] Fix empty Multipart Upload for AWS S3 (#5405)
andrebsguedes Feb 17, 2024
c81c58e
docds(object_store): Mention HTTP/WebDAV in README (#5409)
Xuanwo Feb 20, 2024
39287ca
fix(object_store): Include Content-MD5 header for S3 DeleteObjects (#…
paraseba Feb 21, 2024
df91c4c
Enable anonymous access for MicrosoftAzure (#5425)
andrebsguedes Feb 25, 2024
7f4442f
feat: S3 server-side encryption (#5402)
wjones127 Feb 26, 2024
fe50dce
Update nix requirement from 0.27.1 to 0.28.0 in /object_store (#5432)
dependabot[bot] Feb 26, 2024
27c50d9
Add BufWriter for Adapative Put / Multipart Upload (#5431)
tustvold Feb 27, 2024
8ed5846
Update local.rs (#5441)
metesynnada Feb 29, 2024
bf023aa
Prepare object_store 0.9.1 (#5449)
tustvold Mar 1, 2024
29e259d
Uses ResourceType for filtering directories instead of workaround (#5…
andrebsguedes Mar 3, 2024
292556b
Update base64 requirement from 0.21 to 0.22 in /object_store (#5465)
dependabot[bot] Mar 4, 2024
232dad1
add support for gcp application default auth on windows in object sto…
Itayazolay Mar 6, 2024
d092b35
Update latest chrono (#5479)
tustvold Mar 7, 2024
f0ad78f
Implement MultiPartStore for InMemory (#5495)
tustvold Mar 13, 2024
ce34bc9
Minor: add additional documentation about `BufWriter` (#5519)
alamb Mar 16, 2024
128ccf6
Replace AsyncWrite with Upload trait and rename MultiPartStore to Mul…
tustvold Mar 19, 2024
a24d1d3
fix: copy/rename return error if source is nonexistent (#5528)
dimbtp Mar 20, 2024
1f3038b
Fix Clippy Lints object_store (#5546)
tustvold Mar 23, 2024
62d7251
Update reqwest 0.12 and http 1.0 (#5536)
tustvold Mar 29, 2024
46b55a2
Update error message tests (#5569)
tustvold Mar 29, 2024
4e3dcd5
Implement MultipartStore for ThrottledStore (#5533)
tustvold Mar 29, 2024
7e3a6cd
using latest choron (#5578)
l1nxy Apr 1, 2024
fb10fd0
Add GCS signed URL support (#5300)
l1nxy Apr 4, 2024
1f4731b
Fix handling of empty multipart uploads for GCS (#5590)
tustvold Apr 6, 2024
a34e490
Adds send_retry_with_idempotency and retry more kinds of transport er…
andrebsguedes Apr 9, 2024
a0905ed
Fixed typos in object store (#5629)
Silemo Apr 11, 2024
e468d6c
Support non-contiguous put payloads / vectored writes (#5514) (#5538)
tustvold Apr 15, 2024
5f2997c
Fix flaky test_cleanup_intermediate_files (#5645)
tustvold Apr 15, 2024
2d21ecb
Add Attributes API (#5329) (#5650)
tustvold Apr 16, 2024
d698b8c
Add put_multipart_opts (#5435) (#5652)
tustvold Apr 17, 2024
a8e0528
Prepare object_store 0.10.0 (#5658)
tustvold Apr 18, 2024
01cd318
Add more attributes (#5690)
netthier Apr 26, 2024
f720111
Add `BufWriter::with_attributes` and `::with_tags` in `object_store` …
netthier Apr 26, 2024
cbe489b
Export object_store integration tests (#5709)
tustvold May 4, 2024
502e3c5
Fix PutPayloadMut::push not updating content_length (#5743) (#5744)
tustvold May 10, 2024
932be92
Prepare object_store 0.10.1 (#5745)
tustvold May 10, 2024
b32010e
Add additional WriteMultipart tests (#5743) (#5746)
tustvold May 11, 2024
cc6288d
Update itertools requirement from 0.12.0 to 0.13.0 in /object_store (…
dependabot[bot] May 17, 2024
0736cf9
chore: update docs to delineate which are recursive (#5794)
wiedld May 23, 2024
a2c6cb8
Update nix requirement from 0.28.0 to 0.29.0 in /object_store (#5799)
dependabot[bot] May 24, 2024
bb1e576
Fix issue #5800: Handle missing files in list_with_delimiter (#5803)
hesampakdaman May 25, 2024
9b2140c
Update quick-xml requirement from 0.31.0 to 0.32.0 in /object_store (…
dependabot[bot] Jun 12, 2024
6d9962a
feat(object_store): Add `put` API for buffered::BufWriter (#5835)
Xuanwo Jun 13, 2024
9020ac8
Fix clippy for object_store (#5883)
alamb Jun 13, 2024
15d999f
chore: Remove not used cache in InstanceCredentialProvider (#5888)
Xuanwo Jun 14, 2024
90e94cb
Add `MultipartUpload` blanket implementation for `Box<W>` (#5919)
fsdvh Jun 23, 2024
d41b11a
Update quick-xml requirement from 0.32.0 to 0.33.0 in /object_store (…
dependabot[bot] Jun 24, 2024
834634a
Update quick-xml requirement from 0.33.0 to 0.34.0 in /object_store (…
dependabot[bot] Jun 25, 2024
12be570
Make ObjectStoreScheme public (#5912)
orf Jun 30, 2024
f5e999a
Update quick-xml requirement from 0.34.0 to 0.35.0 in /object_store (…
dependabot[bot] Jul 1, 2024
7c10e6d
Add user defined metadata (#5915)
criccomini Jul 2, 2024
9e601c9
WriteMultipart Abort on MultipartUpload::complete Error (#5974)
fsdvh Jul 2, 2024
6b20fd5
Automatically cleanup empty dirs in LocalFileSystem (#5978)
fsdvh Jul 6, 2024
b8439d0
Update quick-xml requirement from 0.35.0 to 0.36.0 in /object_store (…
dependabot[bot] Jul 10, 2024
9c4c95f
Fix 5592: Colon (:) in in object_store::path::{Path} is not handled o…
hesampakdaman Jul 13, 2024
263ad73
Sanitize error message for sensitive requests (#6074)
tustvold Jul 17, 2024
d6d3c9d
use GCE metadata server env var overrides (#6015)
barronw Jul 17, 2024
e470cae
Correct timeout in comment from 5s to 30s (#6073)
trungda Jul 17, 2024
e109bc9
Prepare for object_store `0.10.2` release (#6079)
alamb Jul 17, 2024
37d0936
Fix clippy in object_store crate (#6120)
alamb Jul 25, 2024
86f2feb
Update object store MSRV to `1.64` (#6123)
alamb Jul 31, 2024
5a18a1c
Make object_store errors non-exhaustive (#6165)
tustvold Aug 2, 2024
58acb7f
Update snafu (#5930) (#6070)
alamb Aug 2, 2024
7f06294
feat(object_store): add `PermissionDenied` variant to top-level erro…
kyle-mccarthy Aug 8, 2024
b04f633
Prepare for object_store `0.11.0` release (#6227)
alamb Aug 12, 2024
09c6a66
Add LICENSE and NOTICE files to object_store (#6234)
alamb Aug 13, 2024
a193537
Update changelog for object_store 0.11.0 release (#6238)
alamb Aug 13, 2024
64f9c85
feat(object_store): add support for server-side encryption with custo…
jiachengdb Aug 15, 2024
15e294d
feat: further TLS options on ClientOptions: #5034 (#6148)
ByteBaker Aug 19, 2024
2124260
Only add encryption headers for for SSE-C in get. (#6260)
jiachengdb Aug 20, 2024
732e910
docs[object_store]: clarify the backoff strategy that is actually imp…
westonpace Aug 29, 2024
1211e50
fix: azure sas token visible in logs (#6323)
alexwilcoxson-rel Sep 2, 2024
32f85b4
[object_store] Propagate env vars as object store client options (#6334)
ccciudatu Sep 4, 2024
c811715
`object_store::GetOptions` derive `Clone` (#6361)
samuelcolvin Sep 6, 2024
8fd9a53
object_store/delimited: Fix `TrailingEscape` condition (#6265)
Turbo87 Sep 6, 2024
55cdf51
Derive `Clone` for `object_store::aws::AmazonS3` (#6414)
ethe Sep 18, 2024
fe9c941
object_score: Support Azure Fabric OAuth Provider (#6382)
RobinLin666 Sep 21, 2024
fcd9f70
feat: expose HTTP/2 max frame size in `object_store` (#6442)
crepererum Sep 23, 2024
f253f16
Update Cargo.toml (#6459)
ashtuchkin Sep 26, 2024
df44c33
chore: add docs, part of #37 (#6453)
ByteBaker Oct 1, 2024
101a097
object_store: enable lint `unreachable_pub` (#6512)
ByteBaker Oct 6, 2024
b95a4f0
[object_store] Retry S3 requests with 200 response with "Error" in bo…
PeterKeDer Oct 7, 2024
7c920ae
object_store: Clarify what is a prefix in list() documentation (#6520)
progval Oct 7, 2024
0864d34
object_store: fix typo in with_connect_timeout_disabled that actually…
adriangb Oct 15, 2024
12d3dfa
Prepare for object_store `0.11.1` release (#6566)
alamb Oct 15, 2024
2eeaa30
Update `object_store` release documentation (#6565)
alamb Oct 16, 2024
688126d
Remove `test_private_bucket` object_store test (#6601)
alamb Oct 20, 2024
6a97a5f
[object_store] fix S3 endpoint and trailing slash result in invalid r…
adbmal Oct 29, 2024
ad0d4ff
Lower GCP token min_ttl to 4 minutes and add backoff to token refresh…
mwylde Oct 30, 2024
919454a
Update quick-xml requirement from 0.36.0 to 0.37.0 in /object_store (…
crepererum Nov 5, 2024
23162d8
Support native S3 conditional writes (#6682)
benesch Nov 8, 2024
246870d
check sign_payload instead of skip_signature before computing checksu…
mherrerarendon Nov 8, 2024
32c2f0d
object_store: Add support for requester pays buckets (#6768)
kylebarron Nov 22, 2024
567bd38
Add AuthorityHost to AzureConfigKey (#6773)
zadeluca Nov 22, 2024
750e79a
Add version to deprecation messages (#6782)
findepi Nov 24, 2024
d54fe5a
Remove APIs deprecated on or before 49.0.0 (#6786)
findepi Nov 25, 2024
1fea3c3
Implement bulk_delete_request for Azure (#5681)
andrebsguedes Nov 25, 2024
d39d865
fix clippy (#6791)
psvri Nov 25, 2024
4963d94
Update references from `master` to `main` (#6795)
alamb Nov 26, 2024
c8aa1da
object-store: remove S3ConditionalPut::ETagPutIfNotExists (#6802)
benesch Nov 30, 2024
27f79e1
Fix multipart uploads with checksums on object locked buckets (#6794)
avantgardnerio Dec 9, 2024
1b2043e
Always explicitly disable `gzip` automatic decompression on reqwest c…
phillipleblanc Dec 11, 2024
b14d44a
Use randomized content ID for Azure multipart uploads (#6869)
avarnon Dec 12, 2024
14dfe42
[object_store]: Version and Changelog for 0.11.2 (#6908)
alamb Dec 20, 2024
4860b01
object_store: Add enabled-by-default "fs" feature (#6636)
Turbo87 Jan 2, 2025
2eacb38
object_store: Migrate from `snafu` to `thiserror` (#6266)
Turbo87 Jan 2, 2025
704d408
Update itertools requirement from 0.13.0 to 0.14.0 in /object_store (…
dependabot[bot] Jan 3, 2025
f54ebf0
Minor clippy fixes (#6942)
psvri Jan 5, 2025
98d1588
Return `BoxStream` with `'static` lifetime from `ObjectStore::list` (…
kylebarron Jan 8, 2025
00b5883
Improve docs for `AmazonS3Builder::from_env` (#6977)
kylebarron Jan 15, 2025
8283d76
Use `u64` range instead of `usize`, for better wasm32 support (#6961)
XiangpengHao Jan 17, 2025
873ed4d
Change Log On Succesful S3 Copy / Multipart Upload to Debug (#7033)
diptanu Jan 28, 2025
28d56f6
Remove all RCs after release (#7060)
kou Feb 2, 2025
347b331
Update rand requirement from 0.8 to 0.9 (#7045)
mbrobbel Feb 2, 2025
1e0c750
Add test of out of order UploadPart (#7047)
tustvold Feb 3, 2025
6c3de45
Fix LocalFileSystem with range request that ends beyond end of file (…
kylebarron Feb 6, 2025
2bed302
Add a custom implementation `LocalFileSystem::list_with_offset` (#7019)
corwinjoy Feb 8, 2025
59e7ab4
object_store/gcp: derive Clone for GoogleCloudStorage (#7112)
james-rms Feb 11, 2025
c763a4c
feat(object_store): random IP address selection (#7123)
crepererum Feb 12, 2025
a4b106b
Revert "Update rand requirement from 0.8 to 0.9 (#7045)" (#7125)
alamb Feb 12, 2025
ef1337a
refactor: remove unused `async` from `InMemory::entry` (#7133)
crepererum Feb 14, 2025
1c9b247
object_store: Disable all compression formats in HTTP reqwest client …
kylewlacy Feb 19, 2025
b4b7fd5
Decouple ObjectStore from Reqwest (#7183)
tustvold Feb 26, 2025
19a2c74
feat: add `Extensions` to object store `GetOptions` (#7170)
crepererum Feb 27, 2025
e43cc61
chore: enable conditional put by default for S3 (#7181)
meteorgan Feb 27, 2025
1a05608
feat: add `Extensions` to object store `PutOptions` (#7213)
crepererum Feb 27, 2025
bd0c489
feat: add `Extensions` to object store `PutMultipartOpts` (#7214)
crepererum Feb 27, 2025
e975177
ObjectStore WASM32 Support (#7226)
tustvold Mar 3, 2025
e71f94e
Prepare object_store 0.12.0 (#7234)
tustvold Mar 5, 2025
7525a3f
Use `doc_auto_cfg`, logo and favicon for docs.rs (#7145)
mbrobbel Mar 8, 2025
6da5ac3
Fix requirement of object store for http-body-util (#7265)
agourlay Mar 11, 2025
8f25abb
Merge branch 'temp' into alamb/import
alamb Mar 20, 2025
6a36dcb
add .gitignore
alamb Mar 20, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
27 changes: 27 additions & 0 deletions .github_changelog_generator
Original file line number Diff line number Diff line change
@@ -0,0 +1,27 @@
#!/bin/bash
#
# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements. See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership. The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing,
# software distributed under the License is distributed on an
# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
# KIND, either express or implied. See the License for the
# specific language governing permissions and limitations
# under the License.
#

# Add special sections for documentation, security and performance
add-sections={"documentation":{"prefix":"**Documentation updates:**","labels":["documentation"]},"security":{"prefix":"**Security updates:**","labels":["security"]},"performance":{"prefix":"**Performance improvements:**","labels":["performance"]}}
# so that the component is shown associated with the issue
issue-line-labels=object-store
# skip non object_store issues
exclude-labels=development-process,invalid,arrow,parquet,arrow-flight,parquet-derive,question
breaking_labels=api-change
99 changes: 99 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,99 @@
Cargo.lock
target
rusty-tags.vi
.history
.flatbuffers/
.idea/
.vscode
.devcontainer
venv/*
# created by doctests
parquet/data.parquet
# release notes cache
.githubchangeloggenerator.cache
.githubchangeloggenerator.cache.log
justfile
.prettierignore
.env
.editorconfig
# local azurite file
__azurite*
__blobstorage__

# .bak files
*.bak
*.bak2
# OS-specific .gitignores

# Mac .gitignore
# General
.DS_Store
.AppleDouble
.LSOverride

# Icon must end with two \r
Icon

# Thumbnails
._*

# Files that might appear in the root of a volume
.DocumentRevisions-V100
.fseventsd
.Spotlight-V100
.TemporaryItems
.Trashes
.VolumeIcon.icns
.com.apple.timemachine.donotpresent

# Directories potentially created on remote AFP share
.AppleDB
.AppleDesktop
Network Trash Folder
Temporary Items
.apdisk

# Linux .gitignore
*~

# temporary files which can be created if a process still has a handle open of a deleted file
.fuse_hidden*

# KDE directory preferences
.directory

# Linux trash folder which might appear on any partition or disk
.Trash-*

# .nfs files are created when an open file is removed but is still being accessed
.nfs*

# Windows .gitignore
# Windows thumbnail cache files
Thumbs.db
Thumbs.db:encryptable
ehthumbs.db
ehthumbs_vista.db

# Dump file
*.stackdump

# Folder config file
[Dd]esktop.ini

# Recycle Bin used on file shares
$RECYCLE.BIN/

# Windows Installer files
*.cab
*.msi
*.msix
*.msm
*.msp

# Windows shortcuts
*.lnk

# Python virtual env in parquet crate
parquet/pytest/venv/
__pycache__/
833 changes: 833 additions & 0 deletions CHANGELOG-old.md

Large diffs are not rendered by default.

72 changes: 72 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,72 @@
<!---
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements. See the NOTICE file
distributed with this work for additional information
regarding copyright ownership. The ASF licenses this file
to you under the Apache License, Version 2.0 (the
"License"); you may not use this file except in compliance
with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing,
software distributed under the License is distributed on an
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND, either express or implied. See the License for the
specific language governing permissions and limitations
under the License.
-->

# Changelog

## [object_store_0.12.0](https://github.com/apache/arrow-rs/tree/object_store_0.12.0) (2025-03-05)

[Full Changelog](https://github.com/apache/arrow-rs/compare/object_store_0.11.2...object_store_0.12.0)

**Breaking changes:**

- feat: add `Extensions` to object store `PutMultipartOpts` [\#7214](https://github.com/apache/arrow-rs/pull/7214) [[object-store](https://github.com/apache/arrow-rs/labels/object-store)] ([crepererum](https://github.com/crepererum))
- feat: add `Extensions` to object store `PutOptions` [\#7213](https://github.com/apache/arrow-rs/pull/7213) [[object-store](https://github.com/apache/arrow-rs/labels/object-store)] ([crepererum](https://github.com/crepererum))
- chore: enable conditional put by default for S3 [\#7181](https://github.com/apache/arrow-rs/pull/7181) [[object-store](https://github.com/apache/arrow-rs/labels/object-store)] ([meteorgan](https://github.com/meteorgan))
- feat: add `Extensions` to object store `GetOptions` [\#7170](https://github.com/apache/arrow-rs/pull/7170) [[object-store](https://github.com/apache/arrow-rs/labels/object-store)] ([crepererum](https://github.com/crepererum))
- feat\(object\_store\): Override DNS Resolution to Randomize IP Selection [\#7123](https://github.com/apache/arrow-rs/pull/7123) [[object-store](https://github.com/apache/arrow-rs/labels/object-store)] ([crepererum](https://github.com/crepererum))
- Use `u64` range instead of `usize`, for better wasm32 support [\#6961](https://github.com/apache/arrow-rs/pull/6961) [[object-store](https://github.com/apache/arrow-rs/labels/object-store)] ([XiangpengHao](https://github.com/XiangpengHao))
- object\_store: Add enabled-by-default "fs" feature [\#6636](https://github.com/apache/arrow-rs/pull/6636) [[object-store](https://github.com/apache/arrow-rs/labels/object-store)] ([Turbo87](https://github.com/Turbo87))
- Return `BoxStream` with `'static` lifetime from `ObjectStore::list` [\#6619](https://github.com/apache/arrow-rs/pull/6619) [[object-store](https://github.com/apache/arrow-rs/labels/object-store)] ([kylebarron](https://github.com/kylebarron))
- object\_store: Migrate from snafu to thiserror [\#6266](https://github.com/apache/arrow-rs/pull/6266) [[object-store](https://github.com/apache/arrow-rs/labels/object-store)] ([Turbo87](https://github.com/Turbo87))

**Implemented enhancements:**

- Object Store: S3 IP address selection is biased [\#7117](https://github.com/apache/arrow-rs/issues/7117) [[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
- object\_store: GCSObjectStore should derive Clone [\#7113](https://github.com/apache/arrow-rs/issues/7113) [[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
- Remove all RCs after release [\#7059](https://github.com/apache/arrow-rs/issues/7059) [[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
- LocalFileSystem::list\_with\_offset is very slow over network file system [\#7018](https://github.com/apache/arrow-rs/issues/7018) [[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
- Release object store `0.11.2` \(non API breaking\) Around Dec 15 2024 [\#6902](https://github.com/apache/arrow-rs/issues/6902) [[object-store](https://github.com/apache/arrow-rs/labels/object-store)]

**Fixed bugs:**

- LocalFileSystem errors with satisfiable range request [\#6749](https://github.com/apache/arrow-rs/issues/6749) [[object-store](https://github.com/apache/arrow-rs/labels/object-store)]

**Merged pull requests:**

- ObjectStore WASM32 Support [\#7226](https://github.com/apache/arrow-rs/pull/7226) [[object-store](https://github.com/apache/arrow-rs/labels/object-store)] ([tustvold](https://github.com/tustvold))
- \[main\] Bump arrow version to 54.2.1 \(\#7207\) [\#7212](https://github.com/apache/arrow-rs/pull/7212) ([alamb](https://github.com/alamb))
- Decouple ObjectStore from Reqwest [\#7183](https://github.com/apache/arrow-rs/pull/7183) [[object-store](https://github.com/apache/arrow-rs/labels/object-store)] ([tustvold](https://github.com/tustvold))
- object\_store: Disable all compression formats in HTTP reqwest client [\#7143](https://github.com/apache/arrow-rs/pull/7143) [[object-store](https://github.com/apache/arrow-rs/labels/object-store)] ([kylewlacy](https://github.com/kylewlacy))
- refactor: remove unused `async` from `InMemory::entry` [\#7133](https://github.com/apache/arrow-rs/pull/7133) [[object-store](https://github.com/apache/arrow-rs/labels/object-store)] ([crepererum](https://github.com/crepererum))
- object\_store/gcp: derive Clone for GoogleCloudStorage [\#7112](https://github.com/apache/arrow-rs/pull/7112) [[object-store](https://github.com/apache/arrow-rs/labels/object-store)] ([james-rms](https://github.com/james-rms))
- Update version to 54.2.0 and add CHANGELOG [\#7110](https://github.com/apache/arrow-rs/pull/7110) ([alamb](https://github.com/alamb))
- Remove all RCs after release [\#7060](https://github.com/apache/arrow-rs/pull/7060) [[object-store](https://github.com/apache/arrow-rs/labels/object-store)] ([kou](https://github.com/kou))
- Update release schedule README.md [\#7053](https://github.com/apache/arrow-rs/pull/7053) ([alamb](https://github.com/alamb))
- Create GitHub releases automatically on tagging [\#7042](https://github.com/apache/arrow-rs/pull/7042) ([kou](https://github.com/kou))
- Change Log On Succesful S3 Copy / Multipart Upload to Debug [\#7033](https://github.com/apache/arrow-rs/pull/7033) [[object-store](https://github.com/apache/arrow-rs/labels/object-store)] ([diptanu](https://github.com/diptanu))
- Prepare for `54.1.0` release [\#7031](https://github.com/apache/arrow-rs/pull/7031) ([alamb](https://github.com/alamb))
- Add a custom implementation `LocalFileSystem::list_with_offset` [\#7019](https://github.com/apache/arrow-rs/pull/7019) [[object-store](https://github.com/apache/arrow-rs/labels/object-store)] ([corwinjoy](https://github.com/corwinjoy))
- Improve docs for `AmazonS3Builder::from_env` [\#6977](https://github.com/apache/arrow-rs/pull/6977) [[object-store](https://github.com/apache/arrow-rs/labels/object-store)] ([kylebarron](https://github.com/kylebarron))
- Fix WASM CI for Rust 1.84 release [\#6963](https://github.com/apache/arrow-rs/pull/6963) ([alamb](https://github.com/alamb))
- Update itertools requirement from 0.13.0 to 0.14.0 in /object\_store [\#6925](https://github.com/apache/arrow-rs/pull/6925) [[object-store](https://github.com/apache/arrow-rs/labels/object-store)] ([dependabot[bot]](https://github.com/apps/dependabot))
- Fix LocalFileSystem with range request that ends beyond end of file [\#6751](https://github.com/apache/arrow-rs/pull/6751) [[object-store](https://github.com/apache/arrow-rs/labels/object-store)] ([kylebarron](https://github.com/kylebarron))



\* *This Changelog was automatically generated by [github_changelog_generator](https://github.com/github-changelog-generator/github-changelog-generator)*
Loading