[Bug]: Sandbox image build failed on eval

[neubig]

Is there an existing issue for the same bug?

• I have checked the troubleshooting document at https://docs.all-hands.dev/modules/usage/troubleshooting
• I have checked the existing issues.

Describe the bug

I ran the following on the eval/24-sep branch:

$ ./evaluation/swe_bench/scripts/run_infer.sh llm.mini HEAD CodeActAgent 2 30 1 princeton-nlp/SWE-bench_Lite test &> ~/sand/eval_log.log

But I'm getting issues pulling the docker image:

�[92m20:44:21 - openhands:ERROR�[0m: runtime_build.py:386 - Sandbox image build failed: 404 Client Error for http+docker://localhost/v1.46/images/ghcr.io/all-hands-ai/runtime:d123cc51fdfb0f69ea7a3c8bdda940d7/json: Not Found ("No such image: ghcr.io/all-hands-ai/runtime:d123cc51fdfb0f69ea7a3c8bdda940d7")

Apparently this is caused by the fact that I ran this on an arm64 processor, which is not supported in SWE-bench evaluation.
To make this more clear for others who do the same thing, we should add a check in the main function of evaluation/swe_bench/run_infer.py and evaluation/swe_bench/eval_infer.py, and throwing an error if the processor type is arm64.

Current OpenHands version

eval/24-sep

Installation and Configuration

git clone

Model and Agent

No response

Operating System

No response

Reproduction Steps

No response

Logs, Errors, Screenshots, and Additional Context

No response

[xingyaoww]

Should be fixed by 9af6399 -- Feel free to reopen if it didn't fix it

[neubig]

Thanks a bunch @xingyaoww ! But it seems like maybe it's still broken? Here's a log. I also deleted all my docker images to be sure it wasn't something residual.

eval_log.log

[xingyaoww]

�[92m23:05:08 - openhands:INFO�[0m: docker.py:31 - ---> [Warning] The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested

ahh i think it is probably because SWE-Bench doesn't officially support arm64 evaluation i believe? So maybe it is related to trying to build amd64 image on arm64?

[neubig]

Ah, I see... Maybe I'd have to do it on a VM.

[github-actions]

OpenHands started fixing the issue! You can monitor the progress here.

[github-actions]

An attempt was made to automatically fix this issue, but it was unsuccessful. A branch named 'openhands-fix-issue-4157' has been created with the attempted changes. You can view the branch here. Manual intervention may be required.

[neubig]

Hmm @xingyaoww , it seems that it's also failing on a computer where I have x86_64

$ arch
x86_64

Here is the log:
eval_log.log

[github-actions]

This issue is stale because it has been open for 30 days with no activity. Remove stale label or comment or this will be closed in 7 days.

[github-actions]

This issue was closed because it has been stalled for over 30 days with no activity.