Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ch] update test times #5663

Merged
merged 2 commits into from
Sep 16, 2024
Merged

[ch] update test times #5663

merged 2 commits into from
Sep 16, 2024

Conversation

clee2000
Copy link
Contributor

@clee2000 clee2000 commented Sep 13, 2024

Took a brief look to check that results looked similar. There were differences in decimals, I assume due to floating point stuff, which made it hard to be sure so I'm not entirely sure they're exactly the same

Copy link

vercel bot commented Sep 13, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Skipped Deployment
Name Status Preview Comments Updated (UTC)
torchci ⬜️ Ignored (Inspect) Visit Preview Sep 16, 2024 6:10pm

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Sep 13, 2024
@clee2000 clee2000 marked this pull request as ready for review September 13, 2024 23:16
@clee2000 clee2000 requested a review from a team September 13, 2024 23:16
Copy link
Contributor

@malfet malfet left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, but see some nits (action v2 sounds too old at this point)

.github/workflows/update-test-times.yml Outdated Show resolved Hide resolved
- name: Install Dependencies
run: pip3 install boto3==1.19.12 rockset==1.0.3
run: python -m pip install boto3==1.19.12 clickhouse-connect==0.7.16 requests==2.26.0
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you please explain why changing python to python3 is necessary?

Suggested change
run: python -m pip install boto3==1.19.12 clickhouse-connect==0.7.16 requests==2.26.0
run: python3 -m pip install boto3==1.19.12 clickhouse-connect==0.7.16 requests==2.26.0

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I switched from python3 to python since I added the setup python step, which makes the default python the version that gets setup in the setup step

tools/torchci/update_test_times.py Outdated Show resolved Hide resolved
endpoint = os.environ["CLICKHOUSE_ENDPOINT"]
# I cannot figure out why these values aren't being handled automatically
# when it is fine in the lambda
if endpoint.startswith("https://"):
Copy link
Contributor

@huydhn huydhn Sep 16, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You might want to use something like https://docs.python.org/3/library/urllib.parse.html to get the hostname, scheme, and port number

Copy link
Contributor Author

@clee2000 clee2000 Sep 16, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I did some testing right now, and it doesn't seem to handle having vs not having https:// well

I also found this in the docs
"Following the syntax specifications in RFC 1808, urlparse recognizes a netloc only if it is properly introduced by ‘//’. Otherwise the input is presumed to be a relative URL and thus to start with a path component."

res = get_clickhouse_client().query(query, params)
json_res = []
# convert to json
for row in res.result_rows:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Interesting, so clickhouse_connect Python client use this format while the typescript one already does the column name mapping. Maybe there is an option to clickhouse_connect, but I haven't been able to find it in https://clickhouse.com/docs/en/integrations/python

@clee2000 clee2000 merged commit fae5ace into main Sep 16, 2024
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants