reth-mdbx-sys fails to run

[malm0d]

Hi there,

I'm coming from Silius which uses Reth as a dependency. I've been getting the following error related to reth-mdbx-sys when I try to build Silius, on a macbook air (M2):

Cargo build:

error: failed to run custom build command for `reth-mdbx-sys v0.12.1-0 (https://github.com/paradigmxyz/reth.git?rev=aa6f2cb0610fb4fa0926b42cfed7f8ff51e0db8a#aa6f2cb0)`
note: To improve backtraces for build dependencies, set the CARGO_PROFILE_DEV_BUILD_OVERRIDE_DEBUG=true environment variable to enable debug information generation.

Caused by:
  process didn't exit successfully: `/Users/malcolmtan/Projects/silius/target/debug/build/reth-mdbx-sys-3a1edaef9f77b8d8/build-script-build` (exit status: 101)
  --- stderr
  thread 'main' panicked at /Users/malcolmtan/.cargo/registry/src/index.crates.io-6f17d22bba15001f/bindgen-0.61.0/ir/context.rs:859:9:
  "MDBX_version_info_struct_(unnamed_at_/Users/malcolmtan/_cargo/git/checkouts/reth-36d3ea1d1152b20c/aa6f2cb/crates/storage/libmdbx-rs/mdbx-sys/libmdbx/mdbx_h_673_3)" is not a valid Ident
  stack backtrace:
     0:        0x10094ddf8 - std::backtrace_rs::backtrace::libunwind::trace::hadefa2fe489b32be
                                 at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/../../backtrace/src/backtrace/libunwind.rs:104:5
     1:        0x10094ddf8 - std::backtrace_rs::backtrace::trace_unsynchronized::h37e8bb3c3fd9c67c
                                 at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
     2:        0x10094ddf8 - std::sys_common::backtrace::_print_fmt::h4994a90b70e9aaa7
                                 at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys_common/backtrace.rs:68:5
     3:        0x10094ddf8 - <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt::hb478ebbfb46e27ce
                                 at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys_common/backtrace.rs:44:22
     4:        0x10096c9e8 - core::fmt::rt::Argument::fmt::hfe2e626e52db21d5
                                 at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/fmt/rt.rs:142:9
     5:        0x10096c9e8 - core::fmt::write::he4d5fa2daff1f531
                                 at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/fmt/mod.rs:1120:17
     6:        0x10094b164 - std::io::Write::write_fmt::hc5a47a68eba63d9f
                                 at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/io/mod.rs:1810:15
     7:        0x10094dc2c - std::sys_common::backtrace::_print::hd47355bf70e1c2da
                                 at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys_common/backtrace.rs:47:5
     8:        0x10094dc2c - std::sys_common::backtrace::print::h79bd952cc5812e7a
                                 at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys_common/backtrace.rs:34:9
     9:        0x10094f7c4 - std::panicking::default_hook::{{closure}}::h82301f6222887737
    10:        0x10094f50c - std::panicking::default_hook::h1e49abbb3f1d7dbf
                                 at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:292:9
    11:        0x10094fc0c - std::panicking::rust_panic_with_hook::h1e70c5d905e30e9d
                                 at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:779:13
    12:        0x10094fb00 - std::panicking::begin_panic_handler::{{closure}}::h399e32952efd26a4
                                 at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:657:13
    13:        0x10094e27c - std::sys_common::backtrace::__rust_end_short_backtrace::h2ab87f841a2323e7
                                 at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/sys_common/backtrace.rs:171:18
    14:        0x10094f888 - rust_begin_unwind
                                 at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:645:5
    15:        0x1009843e4 - core::panicking::panic_fmt::h33e40d2a93cab78f
                                 at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/panicking.rs:72:14
    16:        0x100906d90 - proc_macro2::fallback::validate_ident::h89deb8981f85559b
                                 at /Users/malcolmtan/.cargo/registry/src/index.crates.io-6f17d22bba15001f/proc-macro2-1.0.79/src/fallback.rs:859:9
    17:        0x100906adc - proc_macro2::fallback::Ident::new_checked::h449792e784437a51
                                 at /Users/malcolmtan/.cargo/registry/src/index.crates.io-6f17d22bba15001f/proc-macro2-1.0.79/src/fallback.rs:791:9
    18:        0x1009098e8 - proc_macro2::imp::Ident::new_checked::h1dd82dd6ecac518f
                                 at /Users/malcolmtan/.cargo/registry/src/index.crates.io-6f17d22bba15001f/proc-macro2-1.0.79/src/wrapper.rs:675:50
    19:        0x10091ecdc - proc_macro2::Ident::new::h698c276ed6872cf9
                                 at /Users/malcolmtan/.cargo/registry/src/index.crates.io-6f17d22bba15001f/proc-macro2-1.0.79/src/lib.rs:984:21
    20:        0x10040656c - bindgen::ir::context::BindgenContext::rust_ident_raw::h8597ac5baad6333a
    21:        0x100406348 - bindgen::ir::context::BindgenContext::rust_ident::h4b230bd9c994a1ba
    22:        0x1004877f0 - <bindgen::ir::comp::CompInfo as bindgen::codegen::CodeGenerator>::codegen::h0db8810ca737d0b8
    23:        0x1004daa54 - <bindgen::ir::ty::Type as bindgen::codegen::CodeGenerator>::codegen::h1d81e26eda2db97a
    24:        0x100454f88 - <bindgen::ir::item::Item as bindgen::codegen::CodeGenerator>::codegen::h2afc9c7154dc64ff
    25:        0x10048d0a4 - <bindgen::ir::comp::CompInfo as bindgen::codegen::CodeGenerator>::codegen::h0db8810ca737d0b8
    26:        0x1004daa54 - <bindgen::ir::ty::Type as bindgen::codegen::CodeGenerator>::codegen::h1d81e26eda2db97a
    27:        0x100454f88 - <bindgen::ir::item::Item as bindgen::codegen::CodeGenerator>::codegen::h2afc9c7154dc64ff
    28:        0x1004a897c - <bindgen::ir::module::Module as bindgen::codegen::CodeGenerator>::codegen::{{closure}}::h04c7e94818b89557
    29:        0x1004d8c08 - <bindgen::ir::module::Module as bindgen::codegen::CodeGenerator>::codegen::h5225e373f43a9f20
    30:        0x100454f70 - <bindgen::ir::item::Item as bindgen::codegen::CodeGenerator>::codegen::h2afc9c7154dc64ff
    31:        0x1004b045c - bindgen::codegen::codegen::{{closure}}::hc020c27b0528609f
    32:        0x1004080d8 - bindgen::ir::context::BindgenContext::gen::h055196546f2b177e
    33:        0x1004afebc - bindgen::codegen::codegen::ha664de8009737a33
    34:        0x10044a110 - bindgen::Bindings::generate::h2d76fe559a6708fe
    35:        0x10044843c - bindgen::Builder::generate::h7a3db74e55e8898c
    36:        0x1003651b4 - build_script_build::main::h23bf3d8767fbc25b
    37:        0x100362a30 - core::ops::function::FnOnce::call_once::hc44384a1aaa8c129
    38:        0x100362254 - std::sys_common::backtrace::__rust_begin_short_backtrace::he94fd5228d4c4665
    39:        0x100362820 - std::rt::lang_start::{{closure}}::hba2df2288084ea40
    40:        0x100946c08 - core::ops::function::impls::<impl core::ops::function::FnOnce<A> for &F>::call_once::hde2a2ae1d756c37f
                                 at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/core/src/ops/function.rs:284:13
    41:        0x100946c08 - std::panicking::try::do_call::h96b73f4da16ee7c5
                                 at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:552:40
    42:        0x100946c08 - std::panicking::try::h2cb0c14c1266f147
                                 at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:516:19
    43:        0x100946c08 - std::panic::catch_unwind::hb8cd2580f659030d
                                 at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panic.rs:142:14
    44:        0x100946c08 - std::rt::lang_start_internal::{{closure}}::h00f9c2d0117ea0ef
                                 at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/rt.rs:148:48
    45:        0x100946c08 - std::panicking::try::do_call::h134dfd8876bcc105
                                 at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:552:40
    46:        0x100946c08 - std::panicking::try::h6595e056250d6043
                                 at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panicking.rs:516:19
    47:        0x100946c08 - std::panic::catch_unwind::haad85d5172c9b53a
                                 at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/panic.rs:142:14
    48:        0x100946c08 - std::rt::lang_start_internal::hf4f3eb1e51305b96
                                 at /rustc/07dca489ac2d933c78d3c5158e3f43beefeb02ce/library/std/src/rt.rs:148:20
    49:        0x1003627f8 - std::rt::lang_start::he905562dc73b1584
    50:        0x10036573c - _main

Rust:

rustc --version
rustc 1.76.0 (07dca489a 2024-02-04)

rustup show
Default host: aarch64-apple-darwin
rustup home:  /Users/malcolmtan/.rustup

installed toolchains
--------------------

stable-aarch64-apple-darwin
nightly-aarch64-apple-darwin
1.76.0-aarch64-apple-darwin (default)

active toolchain
----------------

1.76.0-aarch64-apple-darwin (overridden by '/Users/malcolmtan/Projects/silius/rust-toolchain.toml')
rustc 1.76.0 (07dca489a 2024-02-04)

When I try to build Silius on a macbook air (M1, 2020), I dont get the same error and it builds successfully. It uses the same rustc version and the active toolchain is identical. I've tried uninstalling rust and removing Silius, and redo the entire setup process on both M2 and M1 macbooks but the outcome is always the same where it fails on the M2 and succeeds on the M1.

M2 build from reth-mdbx-sys leading up to error:

   Compiling reth-mdbx-sys v0.12.1-0 (https://github.com/paradigmxyz/reth.git?rev=aa6f2cb0610fb4fa0926b42cfed7f8ff51e0db8a#aa6f2cb0)
   Compiling rustls-pemfile v2.1.2
   Compiling alloy-chains v0.1.15
   Compiling heapless v0.7.17
   Compiling snow v0.9.6
   Compiling strum_macros v0.25.3
   Compiling cipher v0.3.0
   Compiling enum-as-inner v0.6.0
   Compiling idna v0.4.0
   Compiling gloo-utils v0.2.0
   Compiling prometheus-client v0.22.2
   Compiling strum v0.25.0
   Compiling linked-hash-map v0.5.6
   Compiling quick-error v1.2.3
   Compiling heck v0.5.0
   Compiling lru-cache v0.1.2
   Compiling resolv-conf v0.7.0
   Compiling gloo-net v0.5.0
   Compiling hickory-proto v0.24.0
   Compiling silius-primitives v0.5.0-alpha (/Users/malcolmtan/Projects/silius/crates/primitives)
   Compiling tokio-rustls v0.25.0
   Compiling reth-network-api v0.1.0 (https://github.com/paradigmxyz/reth.git?rev=aa6f2cb0610fb4fa0926b42cfed7f8ff51e0db8a#aa6f2cb0)
   Compiling rustls-native-certs v0.7.0
   Compiling quick-protobuf-codec v0.3.1
   Compiling prost v0.12.4
   Compiling webpki-roots v0.26.1
   Compiling jsonrpsee-types v0.16.3
   Compiling lru v0.9.0
   Compiling futures-bounded v0.2.3
   Compiling universal-hash v0.4.0
   Compiling prometheus-client-derive-encode v0.4.2
   Compiling autotools v0.2.7
   Compiling hash32 v0.2.1
   Compiling if-addrs v0.10.2
   Compiling dtoa v1.0.9
   Compiling parking_lot_core v0.8.6
   Compiling stable_deref_trait v1.2.0
   Compiling if-watch v3.2.0
   Compiling hickory-resolver v0.24.0
   Compiling prost-types v0.12.4
error: failed to run custom build command for `reth-mdbx-sys v0.12.1-0 (https://github.com/paradigmxyz/reth.git?rev=aa6f2cb0610fb4fa0926b42cfed7f8ff51e0db8a#aa6f2cb0)`

Caused by:
  process didn't exit successfully: `/Users/malcolmtan/Projects/silius/target/debug/build/reth-mdbx-sys-3a1edaef9f77b8d8/build-script-build` (exit status: 101)
  --- stderr
  thread 'main' panicked at /Users/malcolmtan/.cargo/registry/src/index.crates.io-6f17d22bba15001f/bindgen-0.61.0/ir/context.rs:859:9:
  "MDBX_version_info_struct_(unnamed_at_/Users/malcolmtan/_cargo/git/checkouts/reth-36d3ea1d1152b20c/aa6f2cb/crates/storage/libmdbx-rs/mdbx-sys/libmdbx/mdbx_h_673_3)" is not a valid Ident
  note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

M1 build from reth-mdbx-sys and the next few reth crates:

   Compiling reth-mdbx-sys v0.12.1-0 (https://github.com/paradigmxyz/reth.git? 
   rev=aa6f2cb0610fb4fa0926b42cfed7f8ff51e0db8a#aa6f2cb0)
   Compiling rustls-pemfile v2.1.2
   Compiling alloy-chains v0.1.15
   Compiling snow v0.9.6
   Compiling heapless v0.7.17
   Compiling cipher v0.3.0
   Compiling enum-as-inner v0.6.0
   Compiling gloo-utils v0.2.0
   Compiling strum_macros v0.25.3
   Compiling idna v0.4.0
   Compiling heck v0.5.0
   Compiling prometheus-client v0.22.2
   Compiling linked-hash-map v0.5.6
   Compiling quick-error v1.2.3
   Compiling strum v0.25.0
   Compiling lru-cache v0.1.2
   Compiling resolv-conf v0.7.0
   Compiling hickory-proto v0.24.0
   Compiling tokio-rustls v0.25.0
   Compiling gloo-net v0.5.0
   Compiling silius-primitives v0.5.0-alpha (/Users/malcolmtan/Projects/silius/crates/primitives)
   Compiling rustls-native-certs v0.7.0
   Compiling reth-network-api v0.1.0 (https://github.com/paradigmxyz/reth.git?rev=aa6f2cb0610fb4fa0926b42cfed7f8ff51e0db8a#aa6f2cb0)
   Compiling quick-protobuf-codec v0.3.1
   Compiling prost v0.12.4
   Compiling webpki-roots v0.26.1
   Compiling jsonrpsee-types v0.16.3
   Compiling lru v0.9.0
   Compiling futures-bounded v0.2.3
   Compiling universal-hash v0.4.0
   Compiling prometheus-client-derive-encode v0.4.2
   Compiling if-addrs v0.10.2
   Compiling autotools v0.2.7
   Compiling hash32 v0.2.1
   Compiling stable_deref_trait v1.2.0
   Compiling parking_lot_core v0.8.6
   Compiling dtoa v1.0.9
   Compiling prost-types v0.12.4
   Compiling hickory-resolver v0.24.0
   Compiling protobuf-src v1.1.0+21.5
   Compiling if-watch v3.2.0
   Compiling reth-rpc-types v0.1.0 (https://github.com/paradigmxyz/reth.git?rev=aa6f2cb0610fb4fa0926b42cfed7f8ff51e0db8a#aa6f2cb0)

Thought I could open a post here to ask for help from the Reth community to see if anyone has any advice/idea why this is happening or whats the cause of it.

[emhane]

is this still an issue for you @malm0d ?

[juroberttyb]

I faced a similar error on Ubuntu, solved by installing dependencies provided from build from source section in reth book.

apt-get install libclang-dev pkg-config build-essential