Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ROCm] Improve softmax performance. #1740

Open
wants to merge 2 commits into
base: release/2.4
Choose a base branch
from

Fix fast softmax for non-ILP multiple sizes.

65d155c
Select commit
Loading
Failed to load commit list.
Open

[ROCm] Improve softmax performance. #1740

Fix fast softmax for non-ILP multiple sizes.
65d155c
Select commit
Loading
Failed to load commit list.
ROCm Repo Management API / Jenkins failed Jan 30, 2025 in 12h 42m 19s

Tests/Test Inductor/Run pytorch_inductor: warning in 'junit' step

Tests / Test Inductor / Test Inductor / Run pytorch_inductor / Shell Script

Error in sh step, with arguments ./test_pytorch_inductor.sh.

script returned exit code 1
Build log 
+ ./test_pytorch_inductor.sh
+ [[ -z '' ]]
+ DEFAULT_EXECUTION_OPTIONS='-e CUSTOM_TEST_ARTIFACT_BUILD_DIR=build/custom_test_artifacts         -e CUSTOM_TEST_ARTIFACTS_FILE=test_artifacts.zip         --copy-whls'
+ source prepare_docker_env.sh -e 'EXTENSION_BUILD_GFXARCH=gfx90a;gfx908;gfx942' -e CI=1 -e TEST_CONFIG=inductor -e CUSTOM_TEST_ARTIFACT_BUILD_DIR=build/custom_test_artifacts -e CUSTOM_TEST_ARTIFACTS_FILE=test_artifacts.zip --copy-whls
++ set -ex
++ copy_whls=0
++ envvars=()
++ [[ 11 -gt 0 ]]
++ key=-e
++ case $key in
++ envvars+=("-e $2")
++ shift
++ shift
++ [[ 9 -gt 0 ]]
++ key=-e
++ case $key in
++ envvars+=("-e $2")
++ shift
++ shift
++ [[ 7 -gt 0 ]]
++ key=-e
++ case $key in
++ envvars+=("-e $2")
++ shift
++ shift
++ [[ 5 -gt 0 ]]
++ key=-e
++ case $key in
++ envvars+=("-e $2")
++ shift
++ shift
++ [[ 3 -gt 0 ]]
++ key=-e
++ case $key in
++ envvars+=("-e $2")
++ shift
++ shift
++ [[ 1 -gt 0 ]]
++ key=--copy-whls
++ case $key in
++ copy_whls=1
++ shift
++ [[ 0 -gt 0 ]]
++ [[ '' == \t\r\u\e ]]
++ [[ true == \t\r\u\e ]]
++ envvars+=("-e TEST_CORE=${TEST_CORE}")
++ docker ps -a
CONTAINER ID   IMAGE     COMMAND   CREATED   STATUS    PORTS     NAMES
+++ docker ps -q
++ docker kill
"docker kill" requires at least 1 argument.
See 'docker kill --help'.

Usage:  docker kill [OPTIONS] CONTAINER [CONTAINER...]

Kill one or more running containers
++ true
+++ docker ps -a -q
++ docker rm
"docker rm" requires at least 1 argument.
See 'docker rm --help'.

Usage:  docker rm [OPTIONS] CONTAINER [CONTAINER...]

Remove one or more containers
++ true
++ docker pull rocm/pytorch-ci-private:pytorch-linux-jammy-rocm6.3.1-py3.10-4696686eff5fcfb7c6115760ecf972816edad2a2-gfx908_gfx90a_gfx942
pytorch-linux-jammy-rocm6.3.1-py3.10-4696686eff5fcfb7c6115760ecf972816edad2a2-gfx908_gfx90a_gfx942: Pulling from rocm/pytorch-ci-private
Digest: sha256:7bc03f41aad7e22744407dc600a09f1491367ce1ce5366acbaf16a1980c8fcb9
Status: Image is up to date for rocm/pytorch-ci-private:pytorch-linux-jammy-rocm6.3.1-py3.10-4696686eff5fcfb7c6115760ecf972816edad2a2-gfx908_gfx90a_gfx942
docker.io/rocm/pytorch-ci-private:pytorch-linux-jammy-rocm6.3.1-py3.10-4696686eff5fcfb7c6115760ecf972816edad2a2-gfx908_gfx90a_gfx942
++++ dirname prepare_docker_env.sh
+++ cd .
+++ pwd
++ script_dir=/var/z1_miciadmin/internal/workspace/pytorch/pytorch-ci-pipeline
++ docker run --name pytorch-ci-container -e 'EXTENSION_BUILD_GFXARCH=gfx90a;gfx908;gfx942' -e CI=1 -e TEST_CONFIG=inductor -e CUSTOM_TEST_ARTIFACT_BUILD_DIR=build/custom_test_artifacts -e CUSTOM_TEST_ARTIFACTS_FILE=test_artifacts.zip -e TEST_CORE=true -v /var/z1_miciadmin/internal/workspace/pytorch/pytorch-ci-pipeline:/host_workspace -v /var/z1_miciadmin/internal/workspace/pytorch/pytorch-ci-pipeline:/scripts -t -d --network=host --device=/dev/kfd --device=/dev/dri --ipc=host --pid=host --shm-size 8G --group-add video --cap-add=SYS_PTRACE --security-opt seccomp=unconfined rocm/pytorch-ci-private:pytorch-linux-jammy-rocm6.3.1-py3.10-4696686eff5fcfb7c6115760ecf972816edad2a2-gfx908_gfx90a_gfx942 /bin/cat
49bc80f0b1c0c9044a0394e8388c094d77ea9cf5aeacaecd7956d692ebac67d6
++ env -i python3 /var/z1_miciadmin/internal/workspace/pytorch/pytorch-ci-pipeline/pytorch/tools/stats/export_test_times.py
Exporting test times from test-infra
Downloading https://raw.githubusercontent.com/pytorch/test-infra/generated-stats/stats/test-times.json to /var/z1_miciadmin/internal/workspace/pytorch/pytorch-ci-pipeline/pytorch/.additional_ci_files/test-times.json
Could not download https://raw.githubusercontent.com/pytorch/test-infra/generated-stats/stats/test-times.json because: <urlopen error [Errno 101] Network is unreachable>.
Could not download https://raw.githubusercontent.com/pytorch/test-infra/generated-stats/stats/test-times.json because: <urlopen error [Errno 101] Network is unreachable>.
Could not download https://raw.githubusercontent.com/pytorch/test-infra/generated-stats/stats/test-times.json because: <urlopen error [Errno 101] Network is unreachable>.
All retries exhausted, downloading https://raw.githubusercontent.com/pytorch/test-infra/generated-stats/stats/test-times.json failed.
Downloading https://raw.githubusercontent.com/pytorch/test-infra/generated-stats/stats/test-class-times.json to /var/z1_miciadmin/internal/workspace/pytorch/pytorch-ci-pipeline/pytorch/.additional_ci_files/test-class-times.json
Could not download https://raw.githubusercontent.com/pytorch/test-infra/generated-stats/stats/test-class-times.json because: <urlopen error [Errno 101] Network is unreachable>.
Could not download https://raw.githubusercontent.com/pytorch/test-infra/generated-stats/stats/test-class-times.json because: <urlopen error [Errno 101] Network is unreachable>.
Could not download https://raw.githubusercontent.com/pytorch/test-infra/generated-stats/stats/test-class-times.json because: <urlopen error [Errno 101] Network is unreachable>.
All retries exhausted, downloading https://raw.githubusercontent.com/pytorch/test-infra/generated-stats/stats/test-class-times.json failed.
++ python3 /var/z1_miciadmin/internal/workspace/pytorch/pytorch-ci-pipeline/pytorch/tools/stats/export_test_times.py
Exporting test times from test-infra
Downloading https://raw.githubusercontent.com/pytorch/test-infra/generated-stats/stats/test-times.json to /var/z1_miciadmin/internal/workspace/pytorch/pytorch-ci-pipeline/pytorch/.additional_ci_files/test-times.json
Downloading https://raw.githubusercontent.com/pytorch/test-infra/generated-stats/stats/test-class-times.json to /var/z1_miciadmin/internal/workspace/pytorch/pytorch-ci-pipeline/pytorch/.additional_ci_files/test-class-times.json
++ [[ -d .additional_ci_files ]]
++ sed -i -E 's/"\S+rocm\S+"/""/g' /var/z1_miciadmin/internal/workspace/pytorch/pytorch-ci-pipeline/pytorch/.pytorch-test-times.json
sed: can't read /var/z1_miciadmin/internal/workspace/pytorch/pytorch-ci-pipeline/pytorch/.pytorch-test-times.json: No such file or directory
++ true
++ [[ '' != \t\r\u\e ]]
++ docker exec -u root pytorch-ci-container bash -c 'rm -rf /var/lib/jenkins/pytorch'
++ docker cp /var/z1_miciadmin/internal/workspace/pytorch/pytorch-ci-pipeline/pytorch pytorch-ci-container:/var/lib/jenkins/pytorch
++ docker exec -u root pytorch-ci-container bash -c 'chown root:root -R /var/lib/jenkins/pytorch'
++ [[ 1 -eq 1 ]]
++ docker cp /var/z1_miciadmin/internal/workspace/pytorch/pytorch-ci-pipeline/torch-2.4.0a0+git8a7c0b8-cp310-cp310-linux_x86_64.whl pytorch-ci-container:/var/lib/jenkins/pytorch
++ docker cp /var/z1_miciadmin/internal/workspace/pytorch/pytorch-ci-pipeline/test_artifacts.zip pytorch-ci-container:/var/lib/jenkins/pytorch
++ commands=()
++ PYTORCH_DIRECTORY=/var/lib/jenkins/pytorch
++ [[ -n '' ]]
+ source exec_inside_docker.sh --work-dir /var/lib/jenkins/pytorch
++ set -ex
+++ caller
+++ awk '{print $2}'
++ script_to_exec=./test_pytorch_inductor.sh
++ work_dir=/var/lib/jenkins
++ [[ 2 -gt 1 ]]
++ key=--work-dir
++ case $key in
++ work_dir=/var/lib/jenkins/pytorch
++ shift
++ shift
++ [[ 0 -gt 1 ]]
++ echo 'cd /var/lib/jenkins/pytorch'
++ sed -n '/^#### / { s///; :a; n; p; ba; }' ./test_pytorch_inductor.sh
++ docker exec -u root -i pytorch-ci-container bash
+ source /host_workspace/common.sh
++ [[ -d .ci ]]
++ CI_DIR=.ci
++ DOCKER_DIR=.ci
+ pip3 install -r .ci/docker/requirements-ci.txt
Ignoring coremltools: markers 'python_version == "3.12"' don't match your environment
Ignoring librosa: markers 'python_version == "3.12"' don't match your environment
Ignoring numba: markers 'python_version < "3.9"' don't match your environment
Ignoring numba: markers 'python_version == "3.9"' don't match your environment
Ignoring numba: markers 'python_version == "3.12"' don't match your environment
Ignoring scikit-image: markers 'python_version < "3.10"' don't match your environment
Ignoring scipy: markers 'python_version == "3.12"' don't match your environment
Ignoring pywavelets: markers 'python_version >= "3.12"' don't match your environment
Requirement already satisfied: boto3==1.19.12 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 8)) (1.19.12)
Requirement already satisfied: click==8.1.7 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 13)) (8.1.7)
Requirement already satisfied: sympy==1.12.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 18)) (1.12.1)
Requirement already satisfied: coremltools==5.0b5 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 24)) (5.0b5)
Requirement already satisfied: dill==0.3.7 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 35)) (0.3.7)
Requirement already satisfied: expecttest==0.1.6 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 40)) (0.1.6)
Requirement already satisfied: flatbuffers==2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 46)) (2.0)
Requirement already satisfied: hypothesis==5.35.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 51)) (5.35.1)
Requirement already satisfied: junitparser==2.1.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 57)) (2.1.1)
Requirement already satisfied: lark==0.12.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 62)) (0.12.0)
Requirement already satisfied: librosa>=0.6.2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 67)) (0.10.2.post1)
Requirement already satisfied: mypy==1.9.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 96)) (1.9.0)
Requirement already satisfied: networkx==2.8.8 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 102)) (2.8.8)
Requirement already satisfied: numba==0.55.2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 116)) (0.55.2)
Requirement already satisfied: opt-einsum==3.3 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 141)) (3.3.0)
Requirement already satisfied: optree==0.11.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 146)) (0.11.0)
Requirement already satisfied: pillow==10.3.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 159)) (10.3.0)
Requirement already satisfied: protobuf==3.20.2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 164)) (3.20.2)
Requirement already satisfied: psutil==6.0.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 169)) (6.0.0)
Requirement already satisfied: pytest==7.3.2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 174)) (7.3.2)
Requirement already satisfied: pytest-xdist==3.3.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 179)) (3.3.1)
Requirement already satisfied: pytest-flakefinder==1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 184)) (1.1.0)
Requirement already satisfied: pytest-rerunfailures==14.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 189)) (14.0)
Requirement already satisfied: xdoctest==1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 204)) (1.1.0)
Requirement already satisfied: pygments==2.15.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 209)) (2.15.0)
Requirement already satisfied: scikit-image==0.20.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 230)) (0.20.0)
Requirement already satisfied: scipy==1.10.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 240)) (1.10.1)
Requirement already satisfied: tb-nightly==2.13.0a20230426 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 254)) (2.13.0a20230426)
Requirement already satisfied: tlparse==0.3.7 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 259)) (0.3.7)
Requirement already satisfied: typing-extensions in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 265)) (4.12.2)
Requirement already satisfied: unittest-xml-reporting<=3.2.0,>=2.0.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 275)) (3.2.0)
Requirement already satisfied: lintrunner==0.12.5 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 281)) (0.12.5)
Requirement already satisfied: rockset==1.0.3 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 286)) (1.0.3)
Requirement already satisfied: ghstack==0.8.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 291)) (0.8.0)
Requirement already satisfied: jinja2==3.1.4 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 296)) (3.1.4)
Requirement already satisfied: pytest-cpp==2.3.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 301)) (2.3.0)
Requirement already satisfied: z3-solver==4.12.2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 306)) (4.12.2.0)
Requirement already satisfied: tensorboard==2.13.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 311)) (2.13.0)
Requirement already satisfied: pywavelets==1.4.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 316)) (1.4.1)
Requirement already satisfied: lxml==5.0.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 323)) (5.0.0)
Requirement already satisfied: PyGithub==2.3.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from -r .ci/docker/requirements-ci.txt (line 328)) (2.3.0)
Requirement already satisfied: botocore<1.23.0,>=1.22.12 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from boto3==1.19.12->-r .ci/docker/requirements-ci.txt (line 8)) (1.22.12)
Requirement already satisfied: jmespath<1.0.0,>=0.7.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from boto3==1.19.12->-r .ci/docker/requirements-ci.txt (line 8)) (0.10.0)
Requirement already satisfied: s3transfer<0.6.0,>=0.5.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from boto3==1.19.12->-r .ci/docker/requirements-ci.txt (line 8)) (0.5.2)
Requirement already satisfied: mpmath<1.4.0,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy==1.12.1->-r .ci/docker/requirements-ci.txt (line 18)) (1.3.0)
Requirement already satisfied: numpy>=1.14.5 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from coremltools==5.0b5->-r .ci/docker/requirements-ci.txt (line 24)) (1.21.2)
Requirement already satisfied: tqdm in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from coremltools==5.0b5->-r .ci/docker/requirements-ci.txt (line 24)) (4.67.1)
Requirement already satisfied: packaging in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from coremltools==5.0b5->-r .ci/docker/requirements-ci.txt (line 24)) (24.2)
Requirement already satisfied: attrs>=19.2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from hypothesis==5.35.1->-r .ci/docker/requirements-ci.txt (line 51)) (24.3.0)
Requirement already satisfied: sortedcontainers<3.0.0,>=2.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from hypothesis==5.35.1->-r .ci/docker/requirements-ci.txt (line 51)) (2.4.0)
Requirement already satisfied: future in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from junitparser==2.1.1->-r .ci/docker/requirements-ci.txt (line 57)) (1.0.0)
Requirement already satisfied: mypy-extensions>=1.0.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from mypy==1.9.0->-r .ci/docker/requirements-ci.txt (line 96)) (1.0.0)
Requirement already satisfied: tomli>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from mypy==1.9.0->-r .ci/docker/requirements-ci.txt (line 96)) (2.2.1)
Requirement already satisfied: llvmlite<0.39,>=0.38.0rc1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from numba==0.55.2->-r .ci/docker/requirements-ci.txt (line 116)) (0.38.1)
Requirement already satisfied: setuptools in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from numba==0.55.2->-r .ci/docker/requirements-ci.txt (line 116)) (75.1.0)
Requirement already satisfied: iniconfig in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from pytest==7.3.2->-r .ci/docker/requirements-ci.txt (line 174)) (2.0.0)
Requirement already satisfied: pluggy<2.0,>=0.12 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from pytest==7.3.2->-r .ci/docker/requirements-ci.txt (line 174)) (1.5.0)
Requirement already satisfied: exceptiongroup>=1.0.0rc8 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from pytest==7.3.2->-r .ci/docker/requirements-ci.txt (line 174)) (1.2.2)
Requirement already satisfied: execnet>=1.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from pytest-xdist==3.3.1->-r .ci/docker/requirements-ci.txt (line 179)) (2.1.1)
Requirement already satisfied: six in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from xdoctest==1.1.0->-r .ci/docker/requirements-ci.txt (line 204)) (1.16.0)
Requirement already satisfied: imageio>=2.4.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from scikit-image==0.20.0->-r .ci/docker/requirements-ci.txt (line 230)) (2.36.1)
Requirement already satisfied: tifffile>=2019.7.26 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from scikit-image==0.20.0->-r .ci/docker/requirements-ci.txt (line 230)) (2025.1.10)
Requirement already satisfied: lazy_loader>=0.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from scikit-image==0.20.0->-r .ci/docker/requirements-ci.txt (line 230)) (0.4)
Requirement already satisfied: absl-py>=0.4 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from tb-nightly==2.13.0a20230426->-r .ci/docker/requirements-ci.txt (line 254)) (2.1.0)
Requirement already satisfied: grpcio>=1.48.2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from tb-nightly==2.13.0a20230426->-r .ci/docker/requirements-ci.txt (line 254)) (1.69.0)
Requirement already satisfied: google-auth<3,>=1.6.3 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from tb-nightly==2.13.0a20230426->-r .ci/docker/requirements-ci.txt (line 254)) (2.37.0)
Requirement already satisfied: google-auth-oauthlib<1.1,>=0.5 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from tb-nightly==2.13.0a20230426->-r .ci/docker/requirements-ci.txt (line 254)) (1.0.0)
Requirement already satisfied: markdown>=2.6.8 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from tb-nightly==2.13.0a20230426->-r .ci/docker/requirements-ci.txt (line 254)) (3.7)
Requirement already satisfied: requests<3,>=2.21.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from tb-nightly==2.13.0a20230426->-r .ci/docker/requirements-ci.txt (line 254)) (2.32.3)
Requirement already satisfied: tensorboard-data-server<0.8.0,>=0.7.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from tb-nightly==2.13.0a20230426->-r .ci/docker/requirements-ci.txt (line 254)) (0.7.2)
Requirement already satisfied: werkzeug>=1.0.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from tb-nightly==2.13.0a20230426->-r .ci/docker/requirements-ci.txt (line 254)) (3.1.3)
Requirement already satisfied: wheel>=0.26 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from tb-nightly==2.13.0a20230426->-r .ci/docker/requirements-ci.txt (line 254)) (0.44.0)
Requirement already satisfied: geojson<3.0.0,>=2.5.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from rockset==1.0.3->-r .ci/docker/requirements-ci.txt (line 286)) (2.5.0)
Requirement already satisfied: python_dateutil<3.0.0,>=2.5.3 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from rockset==1.0.3->-r .ci/docker/requirements-ci.txt (line 286)) (2.9.0.post0)
Requirement already satisfied: urllib3<2.0.0,>=1.25.3 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from rockset==1.0.3->-r .ci/docker/requirements-ci.txt (line 286)) (1.26.20)
Requirement already satisfied: aiohttp<4,>=3 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from ghstack==0.8.0->-r .ci/docker/requirements-ci.txt (line 291)) (3.11.11)
Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2==3.1.4->-r .ci/docker/requirements-ci.txt (line 296)) (3.0.2)
Requirement already satisfied: colorama in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from pytest-cpp==2.3.0->-r .ci/docker/requirements-ci.txt (line 301)) (0.4.6)
Requirement already satisfied: pynacl>=1.4.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from PyGithub==2.3.0->-r .ci/docker/requirements-ci.txt (line 328)) (1.5.0)
Requirement already satisfied: pyjwt>=2.4.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from pyjwt[crypto]>=2.4.0->PyGithub==2.3.0->-r .ci/docker/requirements-ci.txt (line 328)) (2.10.1)
Requirement already satisfied: Deprecated in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from PyGithub==2.3.0->-r .ci/docker/requirements-ci.txt (line 328)) (1.2.15)
Requirement already satisfied: audioread>=2.1.9 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from librosa>=0.6.2->-r .ci/docker/requirements-ci.txt (line 67)) (3.0.1)
Requirement already satisfied: scikit-learn>=0.20.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from librosa>=0.6.2->-r .ci/docker/requirements-ci.txt (line 67)) (1.6.1)
Requirement already satisfied: joblib>=0.14 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from librosa>=0.6.2->-r .ci/docker/requirements-ci.txt (line 67)) (1.4.2)
Requirement already satisfied: decorator>=4.3.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from librosa>=0.6.2->-r .ci/docker/requirements-ci.txt (line 67)) (5.1.1)
Requirement already satisfied: soundfile>=0.12.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from librosa>=0.6.2->-r .ci/docker/requirements-ci.txt (line 67)) (0.13.0)
Requirement already satisfied: pooch>=1.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from librosa>=0.6.2->-r .ci/docker/requirements-ci.txt (line 67)) (1.8.2)
Requirement already satisfied: soxr>=0.3.2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from librosa>=0.6.2->-r .ci/docker/requirements-ci.txt (line 67)) (0.5.0.post1)
Requirement already satisfied: msgpack>=1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from librosa>=0.6.2->-r .ci/docker/requirements-ci.txt (line 67)) (1.1.0)
Requirement already satisfied: aiohappyeyeballs>=2.3.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from aiohttp<4,>=3->ghstack==0.8.0->-r .ci/docker/requirements-ci.txt (line 291)) (2.4.4)
Requirement already satisfied: aiosignal>=1.1.2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from aiohttp<4,>=3->ghstack==0.8.0->-r .ci/docker/requirements-ci.txt (line 291)) (1.3.2)
Requirement already satisfied: async-timeout<6.0,>=4.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from aiohttp<4,>=3->ghstack==0.8.0->-r .ci/docker/requirements-ci.txt (line 291)) (5.0.1)
Requirement already satisfied: frozenlist>=1.1.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from aiohttp<4,>=3->ghstack==0.8.0->-r .ci/docker/requirements-ci.txt (line 291)) (1.5.0)
Requirement already satisfied: multidict<7.0,>=4.5 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from aiohttp<4,>=3->ghstack==0.8.0->-r .ci/docker/requirements-ci.txt (line 291)) (6.1.0)
Requirement already satisfied: propcache>=0.2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from aiohttp<4,>=3->ghstack==0.8.0->-r .ci/docker/requirements-ci.txt (line 291)) (0.2.1)
Requirement already satisfied: yarl<2.0,>=1.17.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from aiohttp<4,>=3->ghstack==0.8.0->-r .ci/docker/requirements-ci.txt (line 291)) (1.18.3)
Requirement already satisfied: cachetools<6.0,>=2.0.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from google-auth<3,>=1.6.3->tb-nightly==2.13.0a20230426->-r .ci/docker/requirements-ci.txt (line 254)) (5.5.0)
Requirement already satisfied: pyasn1-modules>=0.2.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from google-auth<3,>=1.6.3->tb-nightly==2.13.0a20230426->-r .ci/docker/requirements-ci.txt (line 254)) (0.4.1)
Requirement already satisfied: rsa<5,>=3.1.4 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from google-auth<3,>=1.6.3->tb-nightly==2.13.0a20230426->-r .ci/docker/requirements-ci.txt (line 254)) (4.9)
Requirement already satisfied: requests-oauthlib>=0.7.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from google-auth-oauthlib<1.1,>=0.5->tb-nightly==2.13.0a20230426->-r .ci/docker/requirements-ci.txt (line 254)) (2.0.0)
Requirement already satisfied: platformdirs>=2.5.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from pooch>=1.1->librosa>=0.6.2->-r .ci/docker/requirements-ci.txt (line 67)) (4.3.6)
Requirement already satisfied: cryptography>=3.4.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from pyjwt[crypto]>=2.4.0->PyGithub==2.3.0->-r .ci/docker/requirements-ci.txt (line 328)) (44.0.0)
Requirement already satisfied: cffi>=1.4.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from pynacl>=1.4.0->PyGithub==2.3.0->-r .ci/docker/requirements-ci.txt (line 328)) (1.17.1)
Requirement already satisfied: charset-normalizer<4,>=2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from requests<3,>=2.21.0->tb-nightly==2.13.0a20230426->-r .ci/docker/requirements-ci.txt (line 254)) (3.4.1)
Requirement already satisfied: idna<4,>=2.5 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from requests<3,>=2.21.0->tb-nightly==2.13.0a20230426->-r .ci/docker/requirements-ci.txt (line 254)) (3.10)
Requirement already satisfied: certifi>=2017.4.17 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from requests<3,>=2.21.0->tb-nightly==2.13.0a20230426->-r .ci/docker/requirements-ci.txt (line 254)) (2024.12.14)
Requirement already satisfied: threadpoolctl>=3.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from scikit-learn>=0.20.0->librosa>=0.6.2->-r .ci/docker/requirements-ci.txt (line 67)) (3.5.0)
Requirement already satisfied: wrapt<2,>=1.10 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from Deprecated->PyGithub==2.3.0->-r .ci/docker/requirements-ci.txt (line 328)) (1.17.2)
Requirement already satisfied: pycparser in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from cffi>=1.4.1->pynacl>=1.4.0->PyGithub==2.3.0->-r .ci/docker/requirements-ci.txt (line 328)) (2.22)
Requirement already satisfied: pyasn1<0.7.0,>=0.4.6 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from pyasn1-modules>=0.2.1->google-auth<3,>=1.6.3->tb-nightly==2.13.0a20230426->-r .ci/docker/requirements-ci.txt (line 254)) (0.6.1)
Requirement already satisfied: oauthlib>=3.0.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from requests-oauthlib>=0.7.0->google-auth-oauthlib<1.1,>=0.5->tb-nightly==2.13.0a20230426->-r .ci/docker/requirements-ci.txt (line 254)) (3.2.2)
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable.It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
+ pip3 install ninja
Collecting ninja
  Downloading ninja-1.11.1.3-py3-none-manylinux_2_12_x86_64.manylinux2010_x86_64.whl.metadata (5.3 kB)
Downloading ninja-1.11.1.3-py3-none-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (422 kB)
Installing collected packages: ninja
Successfully installed ninja-1.11.1.3
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable.It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
+ export MAX_JOBS=32
+ MAX_JOBS=32
+ export HIP_VISIBLE_DEVICES=0
+ HIP_VISIBLE_DEVICES=0
+ git submodule update --init --recursive
Submodule 'android/libs/fbjni' (https://github.com/facebookincubator/fbjni.git) registered for path 'android/libs/fbjni'
Submodule 'third_party/NNPACK_deps/FP16' (https://github.com/Maratyszcza/FP16.git) registered for path 'third_party/FP16'
Submodule 'third_party/NNPACK_deps/FXdiv' (https://github.com/Maratyszcza/FXdiv.git) registered for path 'third_party/FXdiv'
Submodule 'third_party/NNPACK' (https://github.com/Maratyszcza/NNPACK.git) registered for path 'third_party/NNPACK'
Submodule 'third_party/VulkanMemoryAllocator' (https://github.com/GPUOpen-LibrariesAndSDKs/VulkanMemoryAllocator.git) registered for path 'third_party/VulkanMemoryAllocator'
Submodule 'third_party/XNNPACK' (https://github.com/google/XNNPACK.git) registered for path 'third_party/XNNPACK'
Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/benchmark'
Submodule 'third_party/cpp-httplib' (https://github.com/yhirose/cpp-httplib.git) registered for path 'third_party/cpp-httplib'
Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo.git) registered for path 'third_party/cpuinfo'
Submodule 'third_party/cudnn_frontend' (https://github.com/NVIDIA/cudnn-frontend.git) registered for path 'third_party/cudnn_frontend'
Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/cutlass'
Submodule 'third_party/eigen' (https://gitlab.com/libeigen/eigen.git) registered for path 'third_party/eigen'
Submodule 'third_party/fbgemm' (https://github.com/pytorch/fbgemm) registered for path 'third_party/fbgemm'
Submodule 'third_party/flatbuffers' (https://github.com/google/flatbuffers.git) registered for path 'third_party/flatbuffers'
Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/fmt'
Submodule 'third_party/foxi' (https://github.com/houseroad/foxi.git) registered for path 'third_party/foxi'
Submodule 'third_party/gemmlowp/gemmlowp' (https://github.com/google/gemmlowp.git) registered for path 'third_party/gemmlowp/gemmlowp'
Submodule 'third_party/gloo' (https://github.com/facebookincubator/gloo) registered for path 'third_party/gloo'
Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest'
Submodule 'third_party/ideep' (https://github.com/intel/ideep) registered for path 'third_party/ideep'
Submodule 'third_party/ittapi' (https://github.com/intel/ittapi.git) registered for path 'third_party/ittapi'
Submodule 'third_party/kineto' (https://github.com/pytorch/kineto) registered for path 'third_party/kineto'
Submodule 'third_party/mimalloc' (https://github.com/microsoft/mimalloc.git) registered for path 'third_party/mimalloc'
Submodule 'third_party/nccl/nccl' (https://github.com/NVIDIA/nccl) registered for path 'third_party/nccl/nccl'
Submodule 'third_party/nlohmann' (https://github.com/nlohmann/json.git) registered for path 'third_party/nlohmann'
Submodule 'third_party/onnx' (https://github.com/onnx/onnx.git) registered for path 'third_party/onnx'
Submodule 'third_party/opentelemetry-cpp' (https://github.com/open-telemetry/opentelemetry-cpp.git) registered for path 'third_party/opentelemetry-cpp'
Submodule 'third_party/pocketfft' (https://github.com/mreineck/pocketfft) registered for path 'third_party/pocketfft'
Submodule 'third_party/protobuf' (https://github.com/protocolbuffers/protobuf.git) registered for path 'third_party/protobuf'
Submodule 'third_party/NNPACK_deps/psimd' (https://github.com/Maratyszcza/psimd.git) registered for path 'third_party/psimd'
Submodule 'third_party/NNPACK_deps/pthreadpool' (https://github.com/Maratyszcza/pthreadpool.git) registered for path 'third_party/pthreadpool'
Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11'
Submodule 'third_party/python-peachpy' (https://github.com/malfet/PeachPy.git) registered for path 'third_party/python-peachpy'
Submodule 'third_party/sleef' (https://github.com/shibatch/sleef) registered for path 'third_party/sleef'
Submodule 'third_party/tensorpipe' (https://github.com/pytorch/tensorpipe.git) registered for path 'third_party/tensorpipe'
Cloning into '/var/lib/jenkins/pytorch/android/libs/fbjni'...
Cloning into '/var/lib/jenkins/pytorch/third_party/FP16'...
Cloning into '/var/lib/jenkins/pytorch/third_party/FXdiv'...
Cloning into '/var/lib/jenkins/pytorch/third_party/NNPACK'...
Cloning into '/var/lib/jenkins/pytorch/third_party/VulkanMemoryAllocator'...
Cloning into '/var/lib/jenkins/pytorch/third_party/XNNPACK'...
Cloning into '/var/lib/jenkins/pytorch/third_party/benchmark'...
Cloning into '/var/lib/jenkins/pytorch/third_party/cpp-httplib'...
Cloning into '/var/lib/jenkins/pytorch/third_party/cpuinfo'...
Cloning into '/var/lib/jenkins/pytorch/third_party/cudnn_frontend'...
Cloning into '/var/lib/jenkins/pytorch/third_party/cutlass'...
Cloning into '/var/lib/jenkins/pytorch/third_party/eigen'...
Cloning into '/var/lib/jenkins/pytorch/third_party/fbgemm'...
Cloning into '/var/lib/jenkins/pytorch/third_party/flatbuffers'...
Cloning into '/var/lib/jenkins/pytorch/third_party/fmt'...
Cloning into '/var/lib/jenkins/pytorch/third_party/foxi'...
Cloning into '/var/lib/jenkins/pytorch/third_party/gemmlowp/gemmlowp'...
Cloning into '/var/lib/jenkins/pytorch/third_party/gloo'...
Cloning into '/var/lib/jenkins/pytorch/third_party/googletest'...
Cloning into '/var/lib/jenkins/pytorch/third_party/ideep'...
Cloning into '/var/lib/jenkins/pytorch/third_party/ittapi'...
Cloning into '/var/lib/jenkins/pytorch/third_party/kineto'...
Cloning into '/var/lib/jenkins/pytorch/third_party/mimalloc'...
Cloning into '/var/lib/jenkins/pytorch/third_party/nccl/nccl'...
Cloning into '/var/lib/jenkins/pytorch/third_party/nlohmann'...
Cloning into '/var/lib/jenkins/pytorch/third_party/onnx'...
Cloning into '/var/lib/jenkins/pytorch/third_party/opentelemetry-cpp'...
Cloning into '/var/lib/jenkins/pytorch/third_party/pocketfft'...
Cloning into '/var/lib/jenkins/pytorch/third_party/protobuf'...
Cloning into '/var/lib/jenkins/pytorch/third_party/psimd'...
Cloning into '/var/lib/jenkins/pytorch/third_party/pthreadpool'...
Cloning into '/var/lib/jenkins/pytorch/third_party/pybind11'...
Cloning into '/var/lib/jenkins/pytorch/third_party/python-peachpy'...
Cloning into '/var/lib/jenkins/pytorch/third_party/sleef'...
Cloning into '/var/lib/jenkins/pytorch/third_party/tensorpipe'...
Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f'
Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3'
Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1'
Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73'
Submodule path 'third_party/VulkanMemoryAllocator': checked out 'a6bfc237255a6bac1513f7c1ebde6d8aed6b5191'
Submodule path 'third_party/XNNPACK': checked out 'fcbf55af6cf28a4627bcd1f703ab7ad843f0f3a2'
Submodule path 'third_party/benchmark': checked out '0d98dba29d66e93259db7daa53a9327df767a415'
Submodule path 'third_party/cpp-httplib': checked out '3b6597bba913d51161383657829b7e644e59c006'
Submodule path 'third_party/cpuinfo': checked out 'd6860c477c99f1fce9e28eb206891af3c0e1a1d7'
Submodule path 'third_party/cudnn_frontend': checked out 'b740542818f36857acf7f9853f749bbad4118c65'
Submodule path 'third_party/cutlass': checked out 'bbe579a9e3beb6ea6626d9227ec32d0dae119a49'
Submodule path 'third_party/eigen': checked out '3147391d946bb4b6c68edd901f2add6ac1f31f8c'
Submodule path 'third_party/fbgemm': checked out 'dbc3157bf256f1339b3fa1fef2be89ac4078be0e'
Submodule 'third_party/asmjit' (https://github.com/asmjit/asmjit.git) registered for path 'third_party/fbgemm/third_party/asmjit'
Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo) registered for path 'third_party/fbgemm/third_party/cpuinfo'
Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/fbgemm/third_party/cutlass'
Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/fbgemm/third_party/googletest'
Submodule 'third_party/hipify_torch' (https://github.com/ROCmSoftwarePlatform/hipify_torch.git) registered for path 'third_party/fbgemm/third_party/hipify_torch'
Cloning into '/var/lib/jenkins/pytorch/third_party/fbgemm/third_party/asmjit'...
Cloning into '/var/lib/jenkins/pytorch/third_party/fbgemm/third_party/cpuinfo'...
Cloning into '/var/lib/jenkins/pytorch/third_party/fbgemm/third_party/cutlass'...
Cloning into '/var/lib/jenkins/pytorch/third_party/fbgemm/third_party/googletest'...
Cloning into '/var/lib/jenkins/pytorch/third_party/fbgemm/third_party/hipify_torch'...
Submodule path 'third_party/fbgemm/third_party/asmjit': checked out 'd3fbf7c9bc7c1d1365a94a45614b91c5a3706b81'
Submodule path 'third_party/fbgemm/third_party/cpuinfo': checked out 'ed8b86a253800bafdb7b25c5c399f91bff9cb1f3'
Submodule path 'third_party/fbgemm/third_party/cutlass': checked out 'fc9ebc645b63f3a6bc80aaefde5c063fb72110d6'
Submodule path 'third_party/fbgemm/third_party/googletest': checked out 'cbf019de22c8dd37b2108da35b2748fd702d1796'
Submodule path 'third_party/fbgemm/third_party/hipify_torch': checked out '23f53b025b466d8ec3c45d52290d3442f7fbe6b1'
Submodule path 'third_party/flatbuffers': checked out '01834de25e4bf3975a9a00e816292b1ad0fe184b'
Submodule path 'third_party/fmt': checked out 'e69e5f977d458f2650bb346dadf2ad30c5320281'
Submodule path 'third_party/foxi': checked out 'c278588e34e535f0bb8f00df3880d26928038cad'
Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350'
Submodule path 'third_party/gloo': checked out '5354032ea08eadd7fc4456477f7f7c6308818509'
Submodule path 'third_party/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929'
Submodule path 'third_party/ideep': checked out '55ca0191687aaf19aca5cdb7881c791e3bea442b'
Submodule 'mkl-dnn' (https://github.com/intel/mkl-dnn.git) registered for path 'third_party/ideep/mkl-dnn'
Cloning into '/var/lib/jenkins/pytorch/third_party/ideep/mkl-dnn'...
Submodule path 'third_party/ideep/mkl-dnn': checked out '1137e04ec0b5251ca2b4400a4fd3c667ce843d67'
Submodule path 'third_party/ittapi': checked out '5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42'
Submodule path 'third_party/kineto': checked out 'be1317644c68b4bfc4646024a6b221066e430031'
Submodule 'libkineto/third_party/dynolog' (https://github.com/facebookincubator/dynolog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog'
Submodule 'libkineto/third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/fmt'
Submodule 'libkineto/third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/googletest'
Cloning into '/var/lib/jenkins/pytorch/third_party/kineto/libkineto/third_party/dynolog'...
Cloning into '/var/lib/jenkins/pytorch/third_party/kineto/libkineto/third_party/fmt'...
Cloning into '/var/lib/jenkins/pytorch/third_party/kineto/libkineto/third_party/googletest'...
Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out '7d04a0053a845370ae06ce317a22a48e9edcc74e'
Submodule 'third_party/DCGM' (https://github.com/NVIDIA/DCGM.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'
Submodule 'third_party/cpr' (https://github.com/libcpr/cpr.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'
Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'
Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'
Submodule 'third_party/glog' (https://github.com/google/glog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog'
Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'
Submodule 'third_party/json' (https://github.com/nlohmann/json.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json'
Submodule 'third_party/pfs' (https://github.com/dtrugman/pfs.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'
Cloning into '/var/lib/jenkins/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'...
Cloning into '/var/lib/jenkins/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'...
Cloning into '/var/lib/jenkins/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'...
Cloning into '/var/lib/jenkins/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'...
Cloning into '/var/lib/jenkins/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/glog'...
Cloning into '/var/lib/jenkins/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'...
Cloning into '/var/lib/jenkins/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/json'...
Cloning into '/var/lib/jenkins/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'...
Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9'
Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400'
Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05'
Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067'
Submodule 'doc' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'
Cloning into '/var/lib/jenkins/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'...
Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4'
Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446'
Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '58d77fa8070e8cec2dc1ed015d66b454c8d78850'
Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5'
Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150'
Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out 'a33701196adfad74917046096bf5a2aa0ab0bb50'
Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '7aca84427f224eeed3144123d5230d5871e93347'
Submodule path 'third_party/mimalloc': checked out 'b66e3214d8a104669c2ec05ae91ebc26a8f5ab78'
Submodule path 'third_party/nccl/nccl': checked out '48bb7fec7953112ff37499a272317f6663f8f600'
Submodule path 'third_party/nlohmann': checked out '87cda1d6646592ac5866dc703c8e1839046a6806'
Submodule path 'third_party/onnx': checked out '990217f043af7222348ca8f0301e17fa7b841781'
Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/onnx/third_party/benchmark'
Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/onnx/third_party/pybind11'
Cloning into '/var/lib/jenkins/pytorch/third_party/onnx/third_party/benchmark'...
Cloning into '/var/lib/jenkins/pytorch/third_party/onnx/third_party/pybind11'...
Submodule path 'third_party/onnx/third_party/benchmark': checked out '2dd015dfef425c866d9a43f2c67d8b52d709acb6'
Submodule path 'third_party/onnx/third_party/pybind11': checked out '5b0a6fc2017fcc176545afe3e09c9f9885283242'
Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878'
Submodule 'third_party/benchmark' (https://github.com/google/benchmark) registered for path 'third_party/opentelemetry-cpp/third_party/benchmark'
Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/opentelemetry-cpp/third_party/googletest'
Submodule 'third_party/ms-gsl' (https://github.com/microsoft/GSL) registered for path 'third_party/opentelemetry-cpp/third_party/ms-gsl'
Submodule 'third_party/nlohmann-json' (https://github.com/nlohmann/json) registered for path 'third_party/opentelemetry-cpp/third_party/nlohmann-json'
Submodule 'third_party/opentelemetry-proto' (https://github.com/open-telemetry/opentelemetry-proto) registered for path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto'
Submodule 'third_party/opentracing-cpp' (https://github.com/opentracing/opentracing-cpp.git) registered for path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp'
Submodule 'third_party/prometheus-cpp' (https://github.com/jupp0r/prometheus-cpp) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp'
Submodule 'tools/vcpkg' (https://github.com/Microsoft/vcpkg) registered for path 'third_party/opentelemetry-cpp/tools/vcpkg'
Cloning into '/var/lib/jenkins/pytorch/third_party/opentelemetry-cpp/third_party/benchmark'...
Cloning into '/var/lib/jenkins/pytorch/third_party/opentelemetry-cpp/third_party/googletest'...
Cloning into '/var/lib/jenkins/pytorch/third_party/opentelemetry-cpp/third_party/ms-gsl'...
Cloning into '/var/lib/jenkins/pytorch/third_party/opentelemetry-cpp/third_party/nlohmann-json'...
Cloning into '/var/lib/jenkins/pytorch/third_party/opentelemetry-cpp/third_party/opentelemetry-proto'...
Cloning into '/var/lib/jenkins/pytorch/third_party/opentelemetry-cpp/third_party/opentracing-cpp'...
Cloning into '/var/lib/jenkins/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp'...
Cloning into '/var/lib/jenkins/pytorch/third_party/opentelemetry-cpp/tools/vcpkg'...
Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2'
Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1'
Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa'
Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d'
Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce'
Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5'
Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d'
Submodule 'civetweb' (https://github.com/civetweb/civetweb.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'
Submodule 'googletest' (https://github.com/google/googletest.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'
Cloning into '/var/lib/jenkins/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'...
Cloning into '/var/lib/jenkins/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'...
Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4'
Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929'
Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50'
Submodule path 'third_party/pocketfft': checked out '9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe'
Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a'
Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/protobuf/third_party/benchmark'
Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/protobuf/third_party/googletest'
Cloning into '/var/lib/jenkins/pytorch/third_party/protobuf/third_party/benchmark'...
Cloning into '/var/lib/jenkins/pytorch/third_party/protobuf/third_party/googletest'...
Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8'
Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081'
Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900'
Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8'
Submodule path 'third_party/pybind11': checked out '3e9dfa2866941655c56877882565e7577de6fc7b'
Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67'
Submodule path 'third_party/sleef': checked out '60e76d2bce17d278b439d9da17177c8f957a9e9b'
Submodule path 'third_party/tensorpipe': checked out '52791a2fd214b2a9dc5759d36725909c1daa7f2e'
Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/tensorpipe/third_party/googletest'
Submodule 'third_party/libnop' (https://github.com/google/libnop.git) registered for path 'third_party/tensorpipe/third_party/libnop'
Submodule 'third_party/libuv' (https://github.com/libuv/libuv.git) registered for path 'third_party/tensorpipe/third_party/libuv'
Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/tensorpipe/third_party/pybind11'
Cloning into '/var/lib/jenkins/pytorch/third_party/tensorpipe/third_party/googletest'...
Cloning into '/var/lib/jenkins/pytorch/third_party/tensorpipe/third_party/libnop'...
Cloning into '/var/lib/jenkins/pytorch/third_party/tensorpipe/third_party/libuv'...
Cloning into '/var/lib/jenkins/pytorch/third_party/tensorpipe/third_party/pybind11'...
Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e'
Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281'
Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '1dff88e5161cba5c59276d2070d2e304e4dcb242'
Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef'
Submodule 'tools/clang' (https://github.com/wjakob/clang-cindex-python3) registered for path 'third_party/tensorpipe/third_party/pybind11/tools/clang'
Cloning into '/var/lib/jenkins/pytorch/third_party/tensorpipe/third_party/pybind11/tools/clang'...
Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5'
+ [[ '' != \t\r\u\e ]]
+ pip3 install torch-2.4.0a0+git8a7c0b8-cp310-cp310-linux_x86_64.whl
Processing ./torch-2.4.0a0+git8a7c0b8-cp310-cp310-linux_x86_64.whl
Requirement already satisfied: filelock in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.4.0a0+git8a7c0b8) (3.16.1)
Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.4.0a0+git8a7c0b8) (4.12.2)
Requirement already satisfied: sympy<=1.12.1 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.4.0a0+git8a7c0b8) (1.12.1)
Requirement already satisfied: networkx in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.4.0a0+git8a7c0b8) (2.8.8)
Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from torch==2.4.0a0+git8a7c0b8) (3.1.4)
Collecting fsspec (from torch==2.4.0a0+git8a7c0b8)
  Downloading fsspec-2024.12.0-py3-none-any.whl.metadata (11 kB)
Requirement already satisfied: mpmath<1.4.0,>=1.1.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from sympy<=1.12.1->torch==2.4.0a0+git8a7c0b8) (1.3.0)
Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.10/lib/python3.10/site-packages (from jinja2->torch==2.4.0a0+git8a7c0b8) (3.0.2)
Downloading fsspec-2024.12.0-py3-none-any.whl (183 kB)
Installing collected packages: fsspec, torch
Successfully installed fsspec-2024.12.0 torch-2.4.0a0+git8a7c0b8
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable.It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
+ apt update

WARNING: apt does not have a stable CLI interface. Use with caution in scripts.

Hit:1 http://repo.radeon.com/rocm/apt/6.3.1 jammy InRelease
Hit:2 https://repo.radeon.com/amdgpu/6.3.1/ubuntu jammy InRelease
Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB]
Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease
Get:5 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB]
Get:6 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2604 kB]
Get:7 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB]
Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [3606 kB]
Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1521 kB]
Get:10 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1229 kB]
Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [3742 kB]
Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2904 kB]
Get:13 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [35.2 kB]
Fetched 16.0 MB in 2s (8926 kB/s)
Reading package lists...
Building dependency tree...
Reading state information...
24 packages can be upgraded. Run 'apt list --upgradable' to see them.
W: http://repo.radeon.com/rocm/apt/6.3.1/dists/jammy/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
W: https://repo.radeon.com/amdgpu/6.3.1/ubuntu/dists/jammy/InRelease: Key is stored in legacy trusted.gpg keyring (/etc/apt/trusted.gpg), see the DEPRECATION section in apt-key(8) for details.
+ apt install -y zip

WARNING: apt does not have a stable CLI interface. Use with caution in scripts.

Reading package lists...
Building dependency tree...
Reading state information...
The following packages were automatically installed and are no longer required:
  cmake-data dh-elpa-helper emacsen-common librhash0 libuv1
Use 'apt autoremove' to remove them.
The following NEW packages will be installed:
  zip
0 upgraded, 1 newly installed, 0 to remove and 24 not upgraded.
Need to get 176 kB of archives.
After this operation, 544 kB of additional disk space will be used.
Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB]
debconf: delaying package configuration, since apt-utils is not installed
Fetched 176 kB in 0s (0 B/s)
Selecting previously unselected package zip.
(Reading database ... 
(Reading database ... 5%
(Reading database ... 10%
(Reading database ... 15%
(Reading database ... 20%
(Reading database ... 25%
(Reading database ... 30%
(Reading database ... 35%
(Reading database ... 40%
(Reading database ... 45%
(Reading database ... 50%
(Reading database ... 55%
(Reading database ... 60%
(Reading database ... 65%
(Reading database ... 70%
(Reading database ... 75%
(Reading database ... 80%
(Reading database ... 85%
(Reading database ... 90%
(Reading database ... 95%
(Reading database ... 100%
(Reading database ... 66723 files and directories currently installed.)
Preparing to unpack .../zip_3.0-12build2_amd64.deb ...
Unpacking zip (3.0-12build2) ...
Setting up zip (3.0-12build2) ...
+ unzip -o test_artifacts.zip
Archive:  test_artifacts.zip
   creating: build/custom_test_artifacts/
   creating: build/custom_test_artifacts/custom-backend-build/
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeCache.txt  
  inflating: build/custom_test_artifacts/custom-backend-build/detect_rocm_version.cc  
  inflating: build/custom_test_artifacts/custom-backend-build/Makefile  
  inflating: build/custom_test_artifacts/custom-backend-build/test_custom_backend  
  inflating: build/custom_test_artifacts/custom-backend-build/cmake_install.cmake  
   creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/TargetDirectories.txt  
 extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/progress.marks  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeDirectoryInformation.cmake  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/cmake.check_cache  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile2  
   creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/progress.make  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.make  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/cmake_clean.cmake  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/depend.make  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o.d  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.ts  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.txt  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/build.make  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/flags.make  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/DependInfo.cmake  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile.cmake  
   creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeScratch/
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeConfigureLog.yaml  
   creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o.d  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/progress.make  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.make  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/cmake_clean.cmake  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/depend.make  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.ts  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.txt  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/build.make  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/flags.make  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/DependInfo.cmake  
   creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/pkgRedirects/
   creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.2/
   creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.2/CompilerIdCXX/
   creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.2/CompilerIdCXX/tmp/
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.2/CompilerIdCXX/CMakeCXXCompilerId.cpp  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.2/CompilerIdCXX/a.out  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.2/CMakeDetermineCompilerABI_C.bin  
   creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.2/CompilerIdC/
   creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.2/CompilerIdC/tmp/
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.2/CompilerIdC/a.out  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.2/CompilerIdC/CMakeCCompilerId.c  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.2/CMakeCXXCompiler.cmake  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.2/CMakeCCompiler.cmake  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.2/CMakeSystem.cmake  
  inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.2/CMakeDetermineCompilerABI_CXX.bin  
   creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeTmp/
  inflating: build/custom_test_artifacts/custom-backend-build/libcustom_backend.so  
  inflating: build/custom_test_artifacts/custom-backend-build/hip_new_types.cc  
   creating: build/custom_test_artifacts/custom-op-build/
  inflating: build/custom_test_artifacts/custom-op-build/CMakeCache.txt  
  inflating: build/custom_test_artifacts/custom-op-build/detect_rocm_version.cc  
  inflating: build/custom_test_artifacts/custom-op-build/Makefile  
  inflating: build/custom_test_artifacts/custom-op-build/cmake_install.cmake  
   creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/
  inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/TargetDirectories.txt  
 extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/progress.marks  
  inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeDirectoryInformation.cmake  
  inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/cmake.check_cache  
  inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile2  
  inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile.cmake  
   creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/
  inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/progress.make  
  inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.make  
  inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/cmake_clean.cmake  
  inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/depend.make  
  inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.ts  
Output truncated.

Details

  • Initialize (1 hr 25 min)
    • Initialize (1 hr 25 min)
      • Initialize (1 hr 25 min)
        • Node info (14 sec)
        • Download CI scripts (15 sec)
  • Build PyTorch (1 hr 45 min)
    • Build PyTorch (1 hr 45 min)
      • Build PyTorch (1 hr 45 min)
        • Node info (16 sec)
        • Checkout Pytorch (28 sec)
        • Check base Docker image existence (7.2 sec)
        • Pull Docker Image (3.1 sec)
        • Build Docker image (1.3 sec)
        • Build PyTorch (36 min)
  • Tests (9 hr 30 min)
    • Test PyTorch (4 ms)
      • Test PyTorch (5 hr 33 min)
        • Node info (18 sec)
        • Run pytorch_test1 (38 min)
        • Node info (1 min 0 sec)
        • Run pytorch_test2 (38 min)
    • Test Distributed (3 ms)
      • Test Distributed (9 hr 30 min)
        • Node info (19 sec)
        • Run pytorch_distributed_1 (3 hr 31 min)
        • Node info (2 min 31 sec)
        • Run pytorch_distributed_2 (2 hr 47 min)
    • Test Inductor (4 ms)
      • Test Inductor (3 hr 50 min)
        • Node info (1 min 43 sec)
        • Run pytorch_inductor (1 hr 3 min)
          Error: script returned exit code 1
          Error: pytorch_inductor failed
          Unstable: 3 tests failed
    • Test PyTorch Slow (3 ms)
      • Test PyTorch Slow (6.8 sec)
    • Microbenchmark (13 sec)
      • Microbenchmark (6.8 sec)
  • Post Build (39 sec)
  • Declarative: Post Actions (4.4 sec)
View more details on ROCm Repo Management API