Skip to content

Latest commit

 

History

History
61 lines (41 loc) · 1.64 KB

README.md

File metadata and controls

61 lines (41 loc) · 1.64 KB
Raw

banner

PokePython

Description

PokePython is a web scraping project that uses Selenium to "catch 'em all" — Pokémons, that is. This project scrapes Pokémon and their variant information from The Silph Road and stores it in an SQLite database for further analysis and usage.

Libraries Used

  • Selenium: For web scraping.
  • SQLite: For data storage.
  • Logging: For logging activity and errors.
  • re (Regex): For pattern matching in strings.
  • time: For controlling the time between requests.
  • os: For filesystem manipulation.

Installation Guide

  1. Create a Virtual Environment (venv)

    python3 -m venv .venv

  2. Activate the Virtual Environment

    • Windows 
      .venv\Scripts\activate
    • macOS and Linux 
      source .venv/bin/activate

  3. Install Dependencies from requirements.txt

    pip install -r requirements.txt

  4. Download chromedriver.exe File

    • Visit the ChromeDriver download page.
    • Download the version that matches your Chrome browser version.
    • Extract the chromedriver.exe file and place it in the chrome folder within the project directory.

Usage

To start catching all the Pokémons, simply run the main.py script.

python main.py

This will initiate the web scraping process and store the data in the SQLite database pokedex.db and as HTML files within the pokedex folder.

License

This project is under the MIT license. See the LICENSE file for more details.