Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add log classification rule to evaluate by line number #4639

Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open

Conversation

PaliC
Copy link
Contributor

@PaliC PaliC commented Oct 13, 2023

Add log classification rule to evaluate by line number

Adds a log classification rule + testing to classify log lines based on their position. A follow up pr will link this to rockset


Stack created with Sapling. Best reviewed with ReviewStack.

@vercel
Copy link

vercel bot commented Oct 13, 2023

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment
Name Status Preview Comments Updated (UTC)
torchci ⬜️ Ignored (Inspect) Visit Preview Oct 19, 2023 9:03pm

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Oct 13, 2023
@PaliC PaliC requested a review from huydhn October 13, 2023 23:34
@PaliC PaliC force-pushed the pr4639 branch 2 times, most recently from a36efe9 to 68e751f Compare October 17, 2023 20:57
PaliC added a commit that referenced this pull request Oct 17, 2023
add ability to view multiple focused log lines at once

Add view of multiple lines using rockset. Currently we just show the
same error line (because there is only one in rockset). Currently, this
is also hidden under a feature flag.

<img width="915" alt="Screenshot 2023-10-13 at 2 28 46 PM"
src="https://github.com/pytorch/test-infra/assets/13758638/4652e132-6886-4c21-9ac4-f208cc4d1edd">

<!--
copilot:summary
-->
### <samp>🤖 Generated by Copilot at a80550d</samp>

This pull request adds the log annotation feature to the test-infra web
app, which allows users to rate the quality of the log output for a job
and to see multiple failure lines for a job. It also updates the backend
SQL queries and the frontend components to handle the new failureLines
and failureLineNumbers properties for jobs, and fixes some minor issues
in the code. The affected files include `JobLinks.tsx`, `LogViewer.tsx`,
`LogAnnotationToggle.tsx`, `types.ts`, `drciUtils.ts`, `searchUtils.ts`,
`log_annotation/[repoOwner]/[repoName]/[annotation].ts`, `metrics.tsx`,
and several files in the `rockset` folder.

---
Stack created with [Sapling](https://sapling-scm.com). Best reviewed
with
[ReviewStack](https://reviewstack.dev/pytorch/test-infra/pull/4637).
* #4640
* #4639
* __->__ #4637

Co-authored-by: PaliC <>
@PaliC PaliC mentioned this pull request Oct 17, 2023
@PaliC PaliC force-pushed the pr4639 branch 3 times, most recently from ba5fec7 to 28df5d7 Compare October 18, 2023 18:10
@PaliC PaliC force-pushed the pr4639 branch 2 times, most recently from e1b0da2 to c67f37c Compare October 18, 2023 18:49
PaliC added a commit that referenced this pull request Oct 18, 2023
[reland] add ability to view multiple focused log lines at once

add ability to view multiple focused log lines at once

Add view of multiple lines using rockset. Currently we just show the
same error line (because there is only one in rockset). Currently, this
is also hidden under a feature flag.

<img width="915" alt="Screenshot 2023-10-13 at 2 28 46 PM"

src="https://github.com/pytorch/test-infra/assets/13758638/4652e132-6886-4c21-9ac4-f208cc4d1edd">

<!--
copilot:summary
-->
### <samp>🤖 Generated by Copilot at a80550d</samp>

This pull request adds the log annotation feature to the test-infra web
app, which allows users to rate the quality of the log output for a job
and to see multiple failure lines for a job. It also updates the backend
SQL queries and the frontend components to handle the new failureLines
and failureLineNumbers properties for jobs, and fixes some minor issues
in the code. The affected files include `JobLinks.tsx`, `LogViewer.tsx`,
`LogAnnotationToggle.tsx`, `types.ts`, `drciUtils.ts`, `searchUtils.ts`,
`log_annotation/[repoOwner]/[repoName]/[annotation].ts`, `metrics.tsx`,
and several files in the `rockset` folder.

Original commit changeset: 3b5dd27

---
Stack created with [Sapling](https://sapling-scm.com). Best reviewed
with
[ReviewStack](https://reviewstack.dev/pytorch/test-infra/pull/4657).
* #4640
* #4639
* __->__ #4657

Co-authored-by: PaliC <>
@PaliC PaliC force-pushed the pr4639 branch 3 times, most recently from 5b1aa3d to 883e4a7 Compare October 19, 2023 20:53
PaliC added 2 commits October 19, 2023 14:03
… on… (#4659)"

Original commit changeset: 06978f0

I'm reasonably confident this works now, though can someone confirm through checking on Vercel
Adds a log classification rule + testing to classify log lines based on their position. A follow up pr will link this to rockset
PaliC added a commit that referenced this pull request Oct 19, 2023
… on… (#4659)" (#4660)

"[reland] [reland] add ability to view multiple focused log lines at on…
(#4659)"


Original commit changeset: 06978f0

I'm reasonably confident this works now, though can someone confirm
through checking on Vercel

---
Stack created with [Sapling](https://sapling-scm.com). Best reviewed
with
[ReviewStack](https://reviewstack.dev/pytorch/test-infra/pull/4660).
* #4640
* #4639
* __->__ #4660

Co-authored-by: PaliC <>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants