Unable to run distributed-sweep-example.json

[dalyles]

Hello,

I'm trying to run the Autotuner for the example file distributed-sweep-example.json
using this command
python3 distributed.py --design gcd --platform sky130hd --config distributed-sweep-example.json tune

I am referencing the "How to use" section of this document: https://openroad-flow-scripts.readthedocs.io/en/latest/user/InstructionsForAutoTuner.html

What I'm trying to understand here is why are there incompatibility issues with the python script? I am using python 3.10.11
For context, Installed Ray using this documentation: https://docs.ray.io/en/latest/ray-overview/installation.html
Under the title "Installing From conda-forge"

Please advise if this was the right direction in getting Ray installed.
Any help is greatly appreciated.

Thanks!

[dalyles]

I dowgraded python to 3.9.16 and the result is more or less the same.

[maliberty]

@vvbandeira can you help?

[vijayank88]

@dalyles
Can you try install AutoTuner using below pip commands:

pip3 install -U --user 'ray[default,tune]==1.11.0' ax-platform hyperopt nevergrad optuna pandas
pip3 install -U --user colorama==0.4.4 bayesian-optimization==1.4.0

[dalyles]

Hello,

When I run the first command I get this message:

ERROR: Could not find a version that satisfies the requirement ray[default,tune]==1.11.0 (from versions: 1.13.0, 2.0.0rc0, 2.0.0rc1, 2.0.0, 2.0.1, 2.1.0, 2.2.0, 2.3.0rc0, 2.3.0, 2.3.1, 2.4.0, 2.5.0)
ERROR: No matching distribution found for ray[default,tune]==1.11.0


Not sure what is happening here.
Thanks!

[vvbandeira]

You can try with 1.13.0, I think the version we had validated might be too old for pip/conda.

[dalyles]

Thank you @vvbandeira

The flow seems to be working. I wanted to ask another question and know if you've run into this issue before:

~/OpenROAD-flow-scripts/flow/util$ python3 distributed.py --design gcd --platform sky130hd --config ../designs/sky130hd/gcd/autotuner.json tune

[WARNING 06-12 10:27:23] ax.service.utils.with_db_settings_base: Ax currently requires a sqlalchemy version below 2.0. This will be addressed in a future release. Disabling SQL storage in Ax for now, if you would like to use SQL storage please install Ax with mysql extras via pip install ax-platform[mysql].
2023-06-12 10:27:25,401 INFO services.py:1470 -- View the Ray dashboard at http://127.0.0.1:8265
[2023-06-12 10:28:55,871 E 335860 335860] core_worker.cc:137: Failed to register worker 01000000ffffffffffffffffffffffffffffffffffffffffffffffff to Raylet. IOError: [RayletClient] Unable to register worker with raylet. No such file or directory

[vvbandeira]

Maybe try to rollback sqlalchemy with pip install 'sqlalchemy<2.0'

[dalyles]

Thank you, this works for the tuning command.

[dalyles]

Now when I'm running the sweep command, I run into this issue:

~/OpenROAD-flow-scripts/flow/util$ python3 distributed.py --design gcd --platform sky130hd --config distributed-sweep-example.json sweep

[INFO TUN-0012] Log folder /home/dlyles/OpenROAD-flow-scripts/flow/logs/sky130hd/gcd.
2023-06-12 11:39:45,271 INFO services.py:1470 -- View the Ray dashboard at http://127.0.0.1:8265
[2023-06-12 11:41:15,778 E 633219 633219] core_worker.cc:137: Failed to register worker 01000000ffffffffffffffffffffffffffffffffffffffffffffffff to Raylet. IOError: [RayletClient] Unable to register worker with raylet. No such file or directory

Is this a similar issue?
Thanks

[vijayank88]

Can you get python3 --version?

[dalyles]

I am using version 3.10.9, this is because I installed ray with pip.
This works successfully for the tune command.

Python 3.9.16 (which I previously used when installing using conda-forge) does not worth for the tune or sweep command
due to compatibility issues.

[vvbandeira]

Could you try the latest version of Ray? I found this