Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Propagate individual sections with titles and prerequisites as needed #19

Closed
wants to merge 29 commits into from

Conversation

aeluro1
Copy link

@aeluro1 aeluro1 commented Feb 7, 2024

Resolves #267 from gt-scheduler/website#267

nathangong and others added 28 commits March 15, 2023 04:24
* This PR updates the endpoint for fetching the list of all available terms
Changed the finals mapping to adhere to the new sections' time format

---------

Co-authored-by: Hailey Ho <[email protected]>
Resolves #13

### Summary
This PR edits the parsing logic so that a section has a final if it satisfies ALL of the following conditions:
1. Has a "Lecture" designation for its schedule type
2. Has at least 2 credit hours
3. Not a VIP course

In addition, this PR also updates how credit hours are parsed from Oscar. Apparently, Oscar's data entry is not very consistent. The current field that the crawler uses to obtain credit hours is unreliable and can be null/undefined. As a result, we would need to combine scraping data from another field to eliminate all null credit hours as much as possible. If null credit hours still exist after this, it will default to 0.

---------

Co-authored-by: Hailey Ho <[email protected]>
* Added request to /classSearch/getTerms to generate the session
* Decorate banner requests with user-agent header

---------
Co-authored-by: Hailey Ho <[email protected]>
* fix ssl issue

* workflow dispatch

* nit

* nit

* nit
* fix ssl issue

* workflow dispatch

* nit

* nit

* nit

* fix action
* fix ssl issue

* workflow dispatch

* nit

* nit

* nit

* fix action

* fixed ssl local error

* fixed linux support

* fixed linux spaces

---------

Co-authored-by: Yatharth Bhargava <[email protected]>
Co-authored-by: Yatharth Bhargava <[email protected]>
@aeluro1
Copy link
Author

aeluro1 commented Feb 7, 2024

This is meant for the crawler-v2 repo. I have no clue why 'compare and create pull request' moved me to the v1 repo...

@aeluro1 aeluro1 closed this Feb 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants