Add aarch64 to TorchData CICD

[ghost]

Please read through our contribution guide prior to
creating your pull request.

• Note that there is a section on requirements related to adding a new DataPipe.

Fixes #{issue number}

Changes

• Adding aarch64 workflow to CICD.
• Setting setup-miniconda to false as conda is installed from "Set linux aarch64 CI"
• Updated post_build_script_linux.sh to support different CPU arch types by finding the arch from there the script is executed.
• Remove torchvision from domain_ci testing as the newer versions of torchvision do not use torchdata.

[ghost]

@atalman Mind looking at this? Believe this should allow aarch64 TorchData build.

[atalman]

LGTM we can merge if CI is green

[msaroufim]

Btw the torchvision tests are expected to fail because they've dropped their use of torchdata so the only job that needs to be green is the BUILD AARCH64

You can however fix the torchvision tests if you pin to an older version https://github.com/pytorch/data/blob/main/.github/workflows/domain_ci.yml#L13

[ghost]

Btw the torchvision tests are expected to fail because they've dropped their use of torchdata so the only job that needs to be green is the BUILD AARCH64

You can however fix the torchvision tests if you pin to an older version https://github.com/pytorch/data/blob/main/.github/workflows/domain_ci.yml#L13

Since this is dropped for torchvision, do we even need the test anymore?

[msaroufim]

yeah probably not, feel free to delete and I can retrigger CI

[msaroufim]

idk what's going on with the linter but try running precommit and see if that unblocks https://github.com/pytorch/data/blob/main/CONTRIBUTING.md#code-style

[ghost]

Looks like Prettier has an issue with "warning" section of the README.md. Wonder how that got by. Will update this PR to include Prettier's update to the README.md which should clear the lint issue. Going to wait and see if the build completes first.

[ghost]

@msaroufim think we are good this time. Want to give it another try?

[msaroufim]

Err not sure what to do here there's way too many failing tests that I'm not sure this is right to merge - wdyt @atalman ?

[ghost]

7 of the 8 were Error: The operation was canceled. we know why they were canceled?MyPy looks like an internal error. Not sure what to think about that one.

[facebook-github-bot]

@msaroufim has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

[ghost]

am closing this as the repo is a little, on pause.