Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Propagate individual sections with titles and prerequisites as needed #19

Closed
wants to merge 29 commits into from

Commits on Mar 15, 2023

  1. Obtain terms from new endpoint (#4)

    * This PR updates the endpoint for fetching the list of all available terms
    nathangong authored Mar 15, 2023
    Configuration menu
    Copy the full SHA
    382b9f9 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    97922d5 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    06c4a3b View commit details
    Browse the repository at this point in the history
  4. Temporarily change NUM_TERMS for first load

    Hailey Ho authored and Hailey Ho committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    7b39b89 View commit details
    Browse the repository at this point in the history
  5. Scrape summer and fall 22

    Hailey Ho committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    c2f6d7c View commit details
    Browse the repository at this point in the history
  6. Scrape summer and fall 2021

    Hailey Ho committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    971115d View commit details
    Browse the repository at this point in the history
  7. Scrape fall 20 and spring 21

    Hailey Ho committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    babf2b3 View commit details
    Browse the repository at this point in the history
  8. Revert back to default

    Hailey Ho committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    6aef1d1 View commit details
    Browse the repository at this point in the history

Commits on Mar 16, 2023

  1. Configuration menu
    Copy the full SHA
    03abbc7 View commit details
    Browse the repository at this point in the history
  2. Finals Time Migration to Crawler v2 (#12)

    Changed the finals mapping to adhere to the new sections' time format
    
    ---------
    
    Co-authored-by: Hailey Ho <[email protected]>
    samarth52 and Hailey Ho authored Mar 16, 2023
    Configuration menu
    Copy the full SHA
    7443eaa View commit details
    Browse the repository at this point in the history

Commits on Mar 17, 2023

  1. Configuration menu
    Copy the full SHA
    b546bde View commit details
    Browse the repository at this point in the history

Commits on Mar 24, 2023

  1. Update Final Parsing Logic (#14)

    Resolves #13
    
    ### Summary
    This PR edits the parsing logic so that a section has a final if it satisfies ALL of the following conditions:
    1. Has a "Lecture" designation for its schedule type
    2. Has at least 2 credit hours
    3. Not a VIP course
    
    In addition, this PR also updates how credit hours are parsed from Oscar. Apparently, Oscar's data entry is not very consistent. The current field that the crawler uses to obtain credit hours is unreliable and can be null/undefined. As a result, we would need to combine scraping data from another field to eliminate all null credit hours as much as possible. If null credit hours still exist after this, it will default to 0.
    
    ---------
    
    Co-authored-by: Hailey Ho <[email protected]>
    nhatnghiho and Hailey Ho authored Mar 24, 2023
    Configuration menu
    Copy the full SHA
    7a3de13 View commit details
    Browse the repository at this point in the history

Commits on Mar 28, 2023

  1. Fixed location bug (#15)

    yatharth-b authored Mar 28, 2023
    Configuration menu
    Copy the full SHA
    a8a3027 View commit details
    Browse the repository at this point in the history

Commits on Apr 22, 2023

  1. Group crawling workflows into the same concurrency group to prevent r…

    …ace condition
    Hailey Ho authored and Hailey Ho committed Apr 22, 2023
    Configuration menu
    Copy the full SHA
    ccb9261 View commit details
    Browse the repository at this point in the history
  2. Edit specified crawling to allow multiple terms

    Hailey Ho authored and Hailey Ho committed Apr 22, 2023
    Configuration menu
    Copy the full SHA
    0686405 View commit details
    Browse the repository at this point in the history

Commits on Apr 30, 2023

  1. Fixed Error in Fetching Courses From Banner (#17)

    * Added request to /classSearch/getTerms to generate the session
    * Decorate banner requests with user-agent header
    
    ---------
    Co-authored-by: Hailey Ho <[email protected]>
    samarth52 authored Apr 30, 2023
    Configuration menu
    Copy the full SHA
    b26b21d View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2023

  1. Update cookie-generating url

    Hailey Ho authored and Hailey Ho committed Jun 5, 2023
    Configuration menu
    Copy the full SHA
    ca136ed View commit details
    Browse the repository at this point in the history

Commits on Aug 3, 2023

  1. Change workflow's variable name to avoid overlapping with system's va…

    …riables
    Hailey Ho authored and Hailey Ho committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    ccd1b7f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b2db8f7 View commit details
    Browse the repository at this point in the history

Commits on Aug 15, 2023

  1. Update README links

    nhatnghiho authored Aug 15, 2023
    Configuration menu
    Copy the full SHA
    f0f5f1f View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2023

  1. Configuration menu
    Copy the full SHA
    cff88e9 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    8724dd9 View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2023

  1. Update mkl-fft version

    nhatnghiho authored Aug 31, 2023
    Configuration menu
    Copy the full SHA
    a88b9fc View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2023

  1. Fix SSL Issue (#24)

    * fix ssl issue
    
    * workflow dispatch
    
    * nit
    
    * nit
    
    * nit
    yatharth-b authored Nov 2, 2023
    Configuration menu
    Copy the full SHA
    bc7d458 View commit details
    Browse the repository at this point in the history
  2. Fix ssl issue (#25)

    * fix ssl issue
    
    * workflow dispatch
    
    * nit
    
    * nit
    
    * nit
    
    * fix action
    yatharth-b authored Nov 2, 2023
    Configuration menu
    Copy the full SHA
    10d2153 View commit details
    Browse the repository at this point in the history
  3. Fix SSL Issue Locally (#26)

    * fix ssl issue
    
    * workflow dispatch
    
    * nit
    
    * nit
    
    * nit
    
    * fix action
    
    * fixed ssl local error
    
    * fixed linux support
    
    * fixed linux spaces
    
    ---------
    
    Co-authored-by: Yatharth Bhargava <[email protected]>
    Co-authored-by: Yatharth Bhargava <[email protected]>
    3 people authored Nov 2, 2023
    Configuration menu
    Copy the full SHA
    3c90588 View commit details
    Browse the repository at this point in the history

Commits on Feb 4, 2024

  1. Configuration menu
    Copy the full SHA
    a795897 View commit details
    Browse the repository at this point in the history

Commits on Feb 7, 2024

  1. Configuration menu
    Copy the full SHA
    991d3d5 View commit details
    Browse the repository at this point in the history
  2. Fixed minor typos

    aeluro1 committed Feb 7, 2024
    Configuration menu
    Copy the full SHA
    539f5a2 View commit details
    Browse the repository at this point in the history