Contribution Attempt: yarn bootstrap: sqlite3 issues

[swisstackle]

Hello guys, I can't wait to help you guys with the development of truffle.
I forked and cloned the repo and then I ran the two commands as mentioned:
npm install yarn -g
and
yarn bootstrap

But I seem to run into and issue with sqlite3 that I've tried to solve in the last couple days.

Here is the command line output that I get from yarn bootstrap:

yarn bootstrap
yarn run v1.22.18
$ npx lerna bootstrap
lerna notice cli v4.0.0
lerna info versioning independent
lerna info bootstrap root only
[1/4] Resolving packages...
[2/4] Fetching packages...
[3/4] Linking dependencies...
warning "@typescript-eslint/eslint-plugin > [email protected]" has unmet peer dependency "typescript@>=2.8.0 || >= 3.2.0-dev || >= 3.3.0-dev || >= 3.4.0-dev || >= 3.5.0-dev || >= 3.6.0-dev || >= 3.6.0-beta || >= 3.7.0-dev || >= 3.7.0-beta".
warning "workspace-aggregator-8a92cdcf-502d-41f4-b453-b0e33d52e307 > @truffle/abi-utils > [email protected]" has unmet peer dependency "@types/node@*".
warning "workspace-aggregator-8a92cdcf-502d-41f4-b453-b0e33d52e307 > @truffle/codec > [email protected]" has unmet peer dependency "ts-node@^8.0.2".
warning "workspace-aggregator-8a92cdcf-502d-41f4-b453-b0e33d52e307 > @truffle/codec > [email protected]" has incorrect peer dependency "typescript@^3.2.2".
warning "workspace-aggregator-8a92cdcf-502d-41f4-b453-b0e33d52e307 > @truffle/compile-solidity > [email protected]" has unmet peer dependency "ts-node@>=8.0.2".
warning "workspace-aggregator-8a92cdcf-502d-41f4-b453-b0e33d52e307 > @truffle/dashboard > @testing-library/[email protected]" has unmet peer dependency "@testing-library/dom@>=7.21.4".
warning "workspace-aggregator-8a92cdcf-502d-41f4-b453-b0e33d52e307 > @truffle/db > @gql2ts/[email protected]" has incorrect peer dependency "graphql@>= 0.10 <15".
warning "workspace-aggregator-8a92cdcf-502d-41f4-b453-b0e33d52e307 > @truffle/debugger > [email protected]" has incorrect peer dependency "mocha@>=6 <9".
warning "workspace-aggregator-8a92cdcf-502d-41f4-b453-b0e33d52e307 > @truffle/db > @gql2ts/from-schema > @gql2ts/[email protected]" has incorrect peer dependency "graphql@>= 0.10 <15".
warning "workspace-aggregator-8a92cdcf-502d-41f4-b453-b0e33d52e307 > @truffle/core > @truffle/preserve-to-buckets > ipfs-http-client > [email protected]" has unmet peer dependency "abort-controller@*".
warning "workspace-aggregator-8a92cdcf-502d-41f4-b453-b0e33d52e307 > @truffle/hdwallet-provider > web3-provider-engine > eth-block-tracker > @babel/[email protected]" has unmet peer dependency "@babel/core@^7.0.0-0".
warning "workspace-aggregator-8a92cdcf-502d-41f4-b453-b0e33d52e307 > @truffle/core > @truffle/preserve-to-buckets > @textile/hub > @textile/buckets > @improbable-eng/[email protected]" has unmet peer dependency "google-protobuf@^3.2.0".
warning "workspace-aggregator-8a92cdcf-502d-41f4-b453-b0e33d52e307 > @truffle/core > @truffle/preserve-to-buckets > @textile/hub > @textile/hub-filecoin > @improbable-eng/[email protected]" has unmet peer dependency "google-protobuf@^3.2.0".
warning "workspace-aggregator-8a92cdcf-502d-41f4-b453-b0e33d52e307 > @truffle/core > @truffle/preserve-to-buckets > ipfs-http-client > multiaddr > dns-over-http-resolver > [email protected]" has unmet peer dependency "node-fetch@*".
[4/4] Building fresh packages...
[32/44] ⠠ tiny-secp256k1
[34/44] ⠐ keccak
[30/44] ⠐ ursa-optional
[27/44] ⠐ sqlite3
**error C:\Users\alain\Git\truffle\node_modules\sqlite3: Command failed.**
Exit code: 1
Command: node-pre-gyp install --fallback-to-build
Arguments:
Directory: C:\Users\alain\Git\truffle\node_modules\sqlite3
Output:
node-pre-gyp info it worked if it ends with ok
node-pre-gyp info using [email protected]
node-pre-gyp info using [email protected] | win32 | x64
node-pre-gyp WARN Using request for node-pre-gyp https download
node-pre-gyp info check checked for "C:\Users\alain\Git\truffle\node_modules\sqlite3\lib\binding\node-v93-win32-x64\node_sqlite3.node" (not found)
node-pre-gyp http GET https://mapbox-node-binary.s3.amazonaws.com/sqlite3/v4.1.1/node-v93-win32-x64.tar.gz
node-pre-gyp http 403 https://mapbox-node-binary.s3.amazonaws.com/sqlite3/v4.1.1/node-v93-win32-x64.tar.gz
node-pre-gyp WARN Tried to download(403): https://mapbox-node-binary.s3.amazonaws.com/sqlite3/v4.1.1/node-v93-win32-x64.tar.gz
node-pre-gyp WARN Pre-built binaries not found for [email protected] and [email protected] (node-v93 ABI, unknown) (falling back to source compile with node-gyp)
node-pre-gyp http 403 status code downloading tarball https://mapbox-node-binary.s3.amazonaws.com/sqlite3/v4.1.1/node-v93-win32-x64.tar.gz
gyp info it worked if it ends with ok
gyp info using [email protected]
gyp info using [email protected] | win32 | x64
gyp info ok
gyp info it worked if it ends with ok
gyp info using [email protected]
gyp info using [email protected] | win32 | x64
gyp info find Python using Python version 3.9.13 found at "C:\Users\alain\AppData\Local\Microsoft\WindowsApps\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\python.exe"
gyp info find VS using VS2019 (16.10.31424.327) found at:
gyp info find VS "C:\Program Files (x86)\Microsoft Visual Studio\2019\Community"
gyp info find VS run with --verbose for detailed information
gyp info spawn C:\Users\alain\AppData\Local\Microsoft\WindowsApps\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\python.exe
gyp info spawn args [
gyp info spawn args   'C:\\Program Files\\nodejs\\node_modules\\npm\\node_modules\\node-gyp\\gyp\\gyp_main.py',
gyp info spawn args   'binding.gyp',
gyp info spawn args   '-f',
gyp info spawn args   'msvs',
gyp info spawn args   '-I',
gyp info spawn args   'C:\\Users\\alain\\Git\\truffle\\node_modules\\sqlite3\\build\\config.gypi',
gyp info spawn args   '-I',
gyp info spawn args   'C:\\Program Files\\nodejs\\node_modules\\npm\\node_modules\\node-gyp\\addon.gypi',
gyp info spawn args   '-I',
gyp info spawn args   'C:\\Users\\alain\\AppData\\Local\\node-gyp\\Cache\\16.14.0\\include\\node\\common.gypi',
gyp info spawn args   '-Dlibrary=shared_library',
gyp info spawn args   '-Dvisibility=default',
gyp info spawn args   '-Dnode_root_dir=C:\\Users\\alain\\AppData\\Local\\node-gyp\\Cache\\16.14.0',
gyp info spawn args   '-Dnode_gyp_dir=C:\\Program Files\\nodejs\\node_modules\\npm\\node_modules\\node-gyp',
gyp info spawn args   '-Dnode_lib_file=C:\\\\Users\\\\alain\\\\AppData\\\\Local\\\\node-gyp\\\\Cache\\\\16.14.0\\\\<(target_arch)\\\\node.lib',
gyp info spawn args   '-Dmodule_root_dir=C:\\Users\\alain\\Git\\truffle\\node_modules\\sqlite3',
gyp info spawn args   '-Dnode_engine=v8',
gyp info spawn args   '--depth=.',
gyp info spawn args   '--no-parallel',
gyp info spawn args   '--generator-output',
gyp info spawn args   'C:\\Users\\alain\\Git\\truffle\\node_modules\\sqlite3\\build',
gyp info spawn args   '-Goutput_dir=.'
gyp info spawn args ]
gyp info ok
gyp info it worked if it ends with ok
gyp info using [email protected]
gyp info using [email protected] | win32 | x64
gyp info spawn C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\MSBuild\Current\Bin\MSBuild.exe
gyp info spawn args [
gyp info spawn args   'build/binding.sln',
gyp info spawn args   '/clp:Verbosity=minimal',
gyp info spawn args   '/nologo',
gyp info spawn args   '/p:Configuration=Release;Platform=x64'
gyp info spawn args ]
Building the projects in this solution one at a time. To enable parallel build, please add the "-m" switch.
  unpack_sqlite_dep
  sqlite3.c
  win_delay_load_hook.cc
  sqlite3.vcxproj -> C:\Users\alain\Git\truffle\node_modules\sqlite3\build\Release\\sqlite3.lib
  backup.cc
C:\Users\alain\AppData\Local\node-gyp\Cache\16.14.0\include\node\node.h(63,10): fatal error C1083: Cannot open include file: 'v8.h': No such file or directory [C:\Users\alain\Git\truffle\node_modules\sqlite3\build\node_sqlite3.vcxproj]
Failed to execute 'C:\Program Files\nodejs\node.exe C:\Program Files\nodejs\node_modules\npm\node_modules\node-gyp\bin\node-gyp.js build --fallback-to-build --module=C:\Users\alain\Git\truffle\node_modules\sqlite3\lib\binding\node-v93-win32-x64\node_sqlite3.node --module_name=node_sqlite3 --module_path=C:\Users\alain\Git\truffle\node_modules\sqlite3\lib\binding\node-v93-win32-x64 --napi_version=8 --node_abi_napi=napi --napi_build_version=0 --node_napi_label=node-v93' (1)
gyp ERR! build error
gyp ERR! stack Error: `C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\MSBuild\Current\Bin\MSBuild.exe` failed with exit code: 1
gyp ERR! stack     at ChildProcess.onExit (C:\Program Files\nodejs\node_modules\npm\node_modules\node-gyp\lib\build.js:194:23)
gyp ERR! stack     at ChildProcess.emit (node:events:520:28)
gyp ERR! stack     at Process.ChildProcess._handle.onexit (node:internal/child_process:291:12)
gyp ERR! System Windows_NT 10.0.19043
gyp ERR! command "C:\\Program Files\\nodejs\\node.exe" "C:\\Program Files\\nodejs\\node_modules\\npm\\node_modules\\node-gyp\\bin\\node-gyp.js" "build" "--fallback-to-build" "--module=C:\\Users\\alain\\Git\\truffle\\node_modules\\sqlite3\\lib\\binding\\node-v93-win32-x64\\node_sqlite3.node" "--module_name=node_sqlite3" "--module_path=C:\\Users\\alain\\Git\\truffle\\node_modules\\sqlite3\\lib\\binding\\node-v93-win32-x64" "--napi_version=8" "--node_abi_napi=napi" "--napi_build_version=0" "--node_napi_label=node-v93"
gyp ERR! cwd C:\Users\alain\Git\truffle\node_modules\sqlite3
gyp ERR! node -v v16.14.0
gyp ERR! node-gyp -v v8.4.1
gyp ERR! not ok
node-pre-gyp ERR! build error
node-pre-gyp ERR! stack Error: Failed to execute 'C:\Program Files\nodejs\node.exe C:\Program Files\nodejs\node_modules\npm\node_modules\node-gyp\bin\node-gyp.js build --fallback-to-build --module=C:\Users\alain\Git\truffle\node_modules\sqlite3\lib\binding\node-v93-win32-x64\node_sqlite3.node --module_name=node_sqlite3 --module_path=C:\Users\alain\Git\truffle\node_modules\sqlite3\lib\binding\node-v93-win32-x64 --napi_version=8 --node_abi_napi=napi --napi_build_version=0 --node_napi_label=node-v93' (1)
node-pre-gyp ERR! stack     at ChildProcess.<anonymous> (C:\Users\alain\Git\truffle\node_modules\node-pre-gyp\lib\util\compile.js:83:29)
node-pre-gyp ERR! stack     at ChildProcess.emit (node:events:520:28)
node-pre-gyp ERR! stack     at maybeClose (node:internal/child_process:1092:16)
node-pre-gyp ERR! stack     at Process.ChildProcess._handle.onexit (node:internal/child_process:302:5)
node-pre-gyp ERR! System Windows_NT 10.0.19043
node-pre-gyp ERR! command "C:\\Program Files\\nodejs\\node.exe" "C:\\Users\\alain\\Git\\truffle\\node_modules\\node-pre-gyp\\bin\\node-pre-gyp" "install" "--fallback-to-build"
node-pre-gyp ERR! cwd C:\Users\alain\Git\truffle\node_modules\sqlite3
node-pre-gyp ERR! node -v v16.14.0




Process stalled
Active handles:
  - WriteStream
  - WriteStream
  - ReadStream
  - Socket
  - Socket
  - ChildProcess
  - Socket
  - Socket
  - ChildProcess
**lerna ERR! yarn install --mutex network:42424 --non-interactive --ignore-engines exited 1 in 'truffle'
lerna ERR! yarn install --mutex network:42424 --non-interactive --ignore-engines exited 1 in 'truffle'
error Command failed with exit code 1.**
info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.

Things Ive tried were:

• Using yarn install instead of bootstrap
• Change yarn versions
• clear npm cache
• reclone and rerun the whole thing multiple times
• install sqlite3 manually (yarn add sqlite3 -W) (gives me the same error: sqlite3: Command failed)

Have you guys ever heard of that issue? I seem to be able to install sqlite3 in other repositories

Update: I have made some progress:

Due to the log file, I figured out that the v8.h in node-gyp was missing. I reinstalled node-gyp and that resolved the issue.

The next error that was coming up that the some file in the scripts folder of truffle still had windows white spaces, so I removed them with sed -i 's/\r//g' and that resolved the issue

Then, another issue came up, which I couldnt solve yet:
When yarn tries to build the truffle dashboard package, I am getting the error 'DISABLE_ESLINT_PLUGIN' is not recognized as an internal or external command which is used in the package.json to run react-scripts without eslint.

According to react-scripts, this tag was added with the version 4.0.2, but the package.json in the dashboard package references version 4.0.0 for react-scripts. This is a little bit confusing to me, because how could you guys build the dashboard package with this tag, if you guys use version 4.0.0?

Here is the PR that added the 'DISABLE_ESLINT_PLUGIN' tag to react-scripts: facebook/create-react-app#10170