Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Building tez-api 0.9.2-1.0 failed, can't download hadoop-hdfs-client-2.7.2.pom #7

Open
rpignolet opened this issue Jan 23, 2024 · 4 comments
Open

Building tez-api 0.9.2-1.0 failed, can't download hadoop-hdfs-client-2.7.2.pom #7

rpignolet opened this issue Jan 23, 2024 · 4 comments

Comments

@rpignolet
Copy link

When trying to build tez-api 0.9.2-1.0, I can't retrieve hadoop-hdfs-client-2.7.2.pom.

Command use to build:

mvn clean install -pl \!tez-ui -Phadoop28 -P\!hadoop27 -DskipTests

Outputs:

[INFO] -----------------------< org.apache.tez:tez-api >-----------------------
[INFO] Building tez-api 0.9.2-1.0                                        [3/28]
[INFO] --------------------------------[ jar ]---------------------------------
Downloading from apache.snapshots.https: https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-hdfs-client/2.7.2/hadoop-hdfs-client-2.7.2.pom
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for tez 0.9.2-1.0:
[INFO] 
[INFO] tez ................................................ SUCCESS [  0.602 s]
[INFO] hadoop-shim ........................................ SUCCESS [  0.521 s]
[INFO] tez-api ............................................ FAILURE [  0.180 s]
[INFO] tez-build-tools .................................... SKIPPED
[INFO] tez-common ......................................... SKIPPED
[INFO] tez-runtime-internals .............................. SKIPPED
[INFO] tez-runtime-library ................................ SKIPPED
[INFO] tez-mapreduce ...................................... SKIPPED
[INFO] tez-examples ....................................... SKIPPED
[INFO] tez-dag ............................................ SKIPPED
[INFO] tez-tests .......................................... SKIPPED
[INFO] tez-ext-service-tests .............................. SKIPPED
[INFO] tez-plugins ........................................ SKIPPED
[INFO] tez-protobuf-history-plugin ........................ SKIPPED
[INFO] tez-yarn-timeline-history .......................... SKIPPED
[INFO] tez-yarn-timeline-history-with-acls ................ SKIPPED
[INFO] tez-yarn-timeline-cache-plugin ..................... SKIPPED
[INFO] tez-yarn-timeline-history-with-fs .................. SKIPPED
[INFO] tez-history-parser ................................. SKIPPED
[INFO] tez-aux-services ................................... SKIPPED
[INFO] tez-tools .......................................... SKIPPED
[INFO] tez-perf-analyzer .................................. SKIPPED
[INFO] tez-job-analyzer ................................... SKIPPED
[INFO] tez-javadoc-tools .................................. SKIPPED
[INFO] hadoop-shim-impls .................................. SKIPPED
[INFO] hadoop-shim-2.8 .................................... SKIPPED
[INFO] tez-dist ........................................... SKIPPED
[INFO] Tez ................................................ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  1.480 s
[INFO] Finished at: 2024-01-23T11:34:51Z
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project tez-api: Could not resolve dependencies for project org.apache.tez:tez-api:jar:0.9.2-1.0: Failed to collect dependencies at org.apache.hadoop:hadoop-hdfs-client:jar:2.7.2: Failed to read artifact descriptor for org.apache.hadoop:hadoop-hdfs-client:jar:2.7.2: Could not transfer artifact org.apache.hadoop:hadoop-hdfs-client:pom:2.7.2 from/to apache.snapshots.https (https://repository.apache.org/content/repositories/snapshots): Access denied to: https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-hdfs-client/2.7.2/hadoop-hdfs-client-2.7.2.pom , ReasonPhrase:Forbidden. -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :tez-api
@rpignolet
Copy link
Author

ping @Pierrotws

@rpignolet
Copy link
Author

rpignolet commented Jan 23, 2024 •
edited
Loading

The domain repository.apache.org was blacklisted in my test, I opened it.

The new output:

[INFO] -----------------------< org.apache.tez:tez-api >-----------------------
[INFO] Building tez-api 0.9.2-1.0                                        [3/28]
[INFO] --------------------------------[ jar ]---------------------------------
[WARNING] The POM for org.apache.hadoop:hadoop-hdfs-client:jar:2.7.2 is missing, no dependency information available
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for tez 0.9.2-1.0:
[INFO] 
[INFO] tez ................................................ SUCCESS [  0.561 s]
[INFO] hadoop-shim ........................................ SUCCESS [  0.596 s]
[INFO] tez-api ............................................ FAILURE [  0.042 s]
[INFO] tez-build-tools .................................... SKIPPED
[INFO] tez-common ......................................... SKIPPED
[INFO] tez-runtime-internals .............................. SKIPPED
[INFO] tez-runtime-library ................................ SKIPPED
[INFO] tez-mapreduce ...................................... SKIPPED
[INFO] tez-examples ....................................... SKIPPED
[INFO] tez-dag ............................................ SKIPPED
[INFO] tez-tests .......................................... SKIPPED
[INFO] tez-ext-service-tests .............................. SKIPPED
[INFO] tez-plugins ........................................ SKIPPED
[INFO] tez-protobuf-history-plugin ........................ SKIPPED
[INFO] tez-yarn-timeline-history .......................... SKIPPED
[INFO] tez-yarn-timeline-history-with-acls ................ SKIPPED
[INFO] tez-yarn-timeline-cache-plugin ..................... SKIPPED
[INFO] tez-yarn-timeline-history-with-fs .................. SKIPPED
[INFO] tez-history-parser ................................. SKIPPED
[INFO] tez-aux-services ................................... SKIPPED
[INFO] tez-tools .......................................... SKIPPED
[INFO] tez-perf-analyzer .................................. SKIPPED
[INFO] tez-job-analyzer ................................... SKIPPED
[INFO] tez-javadoc-tools .................................. SKIPPED
[INFO] hadoop-shim-impls .................................. SKIPPED
[INFO] hadoop-shim-2.8 .................................... SKIPPED
[INFO] tez-dist ........................................... SKIPPED
[INFO] Tez ................................................ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  1.368 s
[INFO] Finished at: 2024-01-23T11:49:10Z
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project tez-api: Could not resolve dependencies for project org.apache.tez:tez-api:jar:0.9.2-1.0: Failure to find org.apache.hadoop:hadoop-hdfs-client:jar:2.7.2 in https://repository.apache.org/content/repositories/snapshots was cached in the local repository, resolution will not be reattempted until the update interval of apache.snapshots.https has elapsed or updates are forced -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :tez-api

@rpignolet
Copy link
Author

Adding a -U to the build command for the the update interval of apache.snapshots.https has elapsed or updates are forced error.

mvn clean install -U -pl \!tez-ui -Phadoop28 -P\!hadoop27 -DskipTests

[INFO] -----------------------< org.apache.tez:tez-api >-----------------------
[INFO] Building tez-api 0.9.2-1.0                                        [3/28]
[INFO] --------------------------------[ jar ]---------------------------------
Downloading from apache.snapshots.https: https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-hdfs-client/2.7.2/hadoop-hdfs-client-2.7.2.pom
Downloading from central: https://repo.maven.apache.org/maven2/org/apache/hadoop/hadoop-hdfs-client/2.7.2/hadoop-hdfs-client-2.7.2.pom
[WARNING] The POM for org.apache.hadoop:hadoop-hdfs-client:jar:2.7.2 is missing, no dependency information available
Downloading from apache.snapshots.https: https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-hdfs-client/2.7.2/hadoop-hdfs-client-2.7.2.jar
Downloading from central: https://repo.maven.apache.org/maven2/org/apache/hadoop/hadoop-hdfs-client/2.7.2/hadoop-hdfs-client-2.7.2.jar
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for tez 0.9.2-1.0:
[INFO] 
[INFO] tez ................................................ SUCCESS [  0.547 s]
[INFO] hadoop-shim ........................................ SUCCESS [  0.547 s]
[INFO] tez-api ............................................ FAILURE [  0.730 s]
[INFO] tez-build-tools .................................... SKIPPED
[INFO] tez-common ......................................... SKIPPED
[INFO] tez-runtime-internals .............................. SKIPPED
[INFO] tez-runtime-library ................................ SKIPPED
[INFO] tez-mapreduce ...................................... SKIPPED
[INFO] tez-examples ....................................... SKIPPED
[INFO] tez-dag ............................................ SKIPPED
[INFO] tez-tests .......................................... SKIPPED
[INFO] tez-ext-service-tests .............................. SKIPPED
[INFO] tez-plugins ........................................ SKIPPED
[INFO] tez-protobuf-history-plugin ........................ SKIPPED
[INFO] tez-yarn-timeline-history .......................... SKIPPED
[INFO] tez-yarn-timeline-history-with-acls ................ SKIPPED
[INFO] tez-yarn-timeline-cache-plugin ..................... SKIPPED
[INFO] tez-yarn-timeline-history-with-fs .................. SKIPPED
[INFO] tez-history-parser ................................. SKIPPED
[INFO] tez-aux-services ................................... SKIPPED
[INFO] tez-tools .......................................... SKIPPED
[INFO] tez-perf-analyzer .................................. SKIPPED
[INFO] tez-job-analyzer ................................... SKIPPED
[INFO] tez-javadoc-tools .................................. SKIPPED
[INFO] hadoop-shim-impls .................................. SKIPPED
[INFO] hadoop-shim-2.8 .................................... SKIPPED
[INFO] tez-dist ........................................... SKIPPED
[INFO] Tez ................................................ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  1.993 s
[INFO] Finished at: 2024-01-23T11:51:52Z
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project tez-api: Could not resolve dependencies for project org.apache.tez:tez-api:jar:0.9.2-1.0: Could not find artifact org.apache.hadoop:hadoop-hdfs-client:jar:2.7.2 in apache.snapshots.https (https://repository.apache.org/content/repositories/snapshots) -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :tez-api

@SteBaum
Copy link

SteBaum commented Feb 15, 2024

The issue has been solved. The hadoop version in the pom.xml has been changed from 2.7.2 to 3.1.1-0.0.

@SteBaum SteBaum closed this as completed Feb 15, 2024
@SteBaum SteBaum reopened this Feb 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@rpignolet @SteBaum