Welcome to the Web Scraping Project! This repository contains code for a web scraping API built with FastAPI and a frontend UI using Next.js, TypeScript, and TailwindCSS.
This project allows users to scrape data from various companies' websites and display it through a modern UI. The backend is powered by FastAPI while the frontend is built with Next.js, TypeScript, and TailwindCSS.
✨ Fast and efficient web scraping using FastAPI
💅 Modern, responsive UI with Next.js and TailwindCSS
🛠 Easy setup and deployment
-
Clone the repository:
git clone https://github.com/your_username/your_repository.git cd your_repository/backend
-
Install the required dependencies:
pip install -r requirements.txt
-
Run the FastAPI server:
uvicorn main:app --reload
-
Navigate to the frontend directory:
cd ../frontend
-
Install the required dependencies:
npm install
-
Run the Next.js development server:
npm run dev
- Start the FastAPI server.
- Start the Next.js development server.
- Open your web browser and visit
http://localhost:3000
to interact with the UI.
The following companies are included in the scraping list:
The frontend is developed using Next.js with TypeScript and styled using TailwindCSS. It provides a sleek, modern interface for interacting with the scraping API.