Skip to content

object_store: Azure brokenness on 0.12.0 #326

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
a10y opened this issue Apr 2, 2025 · 1 comment
Closed

object_store: Azure brokenness on 0.12.0 #326

a10y opened this issue Apr 2, 2025 · 1 comment
Labels
bug Something isn't working

Comments

@a10y
Copy link

a10y commented Apr 2, 2025

Describe the bug

I've been investigating some Vortex queries on Azure Blob Store Gen2. I've created a simple storage account, populated some files, and was just trying to list the bucket on 0.12

Cargo.toml:

[package]
name = "rustazuretest"
version = "0.1.0"
edition = "2024"

[dependencies]
tokio = { version = "1", features = ["full"] }
object_store = { version = "=0.12", features = ["azure"] }
futures = "0.3"

main.rs

use futures::StreamExt;
use object_store::azure::MicrosoftAzureBuilder;
use object_store::ObjectStore;

#[tokio::main]
async fn main() {
    let account = "vortexicebergsummit25";
    let access_key = "REDACTED";
    let container_name = "tpch";

    let azure = MicrosoftAzureBuilder::new()
        .with_account(account)
        .with_access_key(access_key)
        .with_container_name(container_name)
        .build()
        .expect("azure object store");

    let mut objects = azure.list(None);
    while let Some(next) = objects.next().await {
        println!("Object: {:?}", next.unwrap());
    }
}

On 0.12 this results in an error:

called `Result::unwrap()` on an `Err` value: Generic { store: "MicrosoftAzure", source: ListRequest { source: RetryError { method: GET, uri: Some(https://vortexicebergsummit25.blob.core.windows.net/tpch?&restype=container&comp=list), retries: 0, max_retries: 10, elapsed: 61.271375ms, retry_timeout: 180s, inner: Status { status: 403, body: Some("\u{feff}<?xml version=\"1.0\" encoding=\"utf-8\"?><Error><Code>AuthenticationFailed</Code><Message>Server failed to authenticate the request. Make sure the value of Authorization header is formed correctly including the signature.\nRequestId:1fe66e1c-a01e-0000-2a10-a476a8000000\nTime:2025-04-02T20:45:18.2401813Z</Message><AuthenticationErrorDetail>The MAC signature found in the HTTP request 'REDACTED' is not the same as any computed signature. Server used following string to sign: 'GET\n\n\n\n\n\nWed, 02 Apr 2025 20:45:18 GMT\n\n\n\n\n\nx-ms-version:2023-11-03\n/vortexicebergsummit25/tpch\n:\ncomp:list\nrestype:container'.</AuthenticationErrorDetail></Error>") } } } }
stack backtrace:
...

However, if I forcibly pin to 0.11.2, it works

[package]
name = "rustazuretest"
version = "0.1.0"
edition = "2024"

[dependencies]
tokio = { version = "1", features = ["full"] }
object_store = { version = "=0.11.2", features = ["azure"] }
futures = "0.3"

Image

@a10y a10y added the bug Something isn't working label Apr 2, 2025
@a10y
Copy link
Author

a10y commented Apr 2, 2025

Closing, posting on the new repo: #320

@a10y a10y closed this as completed Apr 2, 2025
@alamb alamb transferred this issue from apache/arrow-rs Apr 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant