Skip to content
/ GitScraper Public

Scraper, parser, and ast compiler for transforming language code bodies into code:comment relationships. Used for auto comment generation in ML.

0 stars 0 forks Branches Tags Activity
Star
Notifications You must be signed in to change notification settings

Compiler/GitScraper

BranchesTags

Repository files navigation

Github Scraper for file extension

How to use

  • Run 'make req' or 'pip3 install requirements.txt'

  • Then run 'make' or 'python3 src/core.py'

  • You may have to download the correct version of the chromedriver from : https://chromedriver.chromium.org/downloads

  • Copy paste that download to overwrite the one in the repo

Additional Options

  • Choose a file extension (or multiple) to scrape for, java is the default
  • Set the amount of projects to scrape
  • Cntrl c or wait till finished

About

Scraper, parser, and ast compiler for transforming language code bodies into code:comment relationships. Used for auto comment generation in ML.

Resources

Readme
Activity

Stars

0 stars

Watchers

3 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

No packages published

Languages