Skip to content

Dakshya52/AI_Data_Extraction

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Data Extraction and Processing Application

AI Data Extraction Dashboard AI Data Extraction Dashboard AI Data Extraction Dashboard

Overview

This project is a comprehensive data extraction and processing application that allows users to upload data files, perform searches using SerpAPI, and extract information using Groq-based processing. The application consists of a React frontend for user interaction and a Node.js backend for handling file processing, API interactions, and data extraction.


Features

1. File Upload and Processing

  • Users can upload files (e.g., CSV files) through the frontend interface.
  • Uploaded files are processed to extract columns and provide a preview of data.

2. Column and Value Selection with Prompt

  • After uploading, users can select a specific column and value for focused data queries.
  • Users can provide custom prompts to tailor the data extraction process.

3. SerpAPI Integration

  • The application performs web searches using SerpAPI to enrich data.
  • It supports retries using exponential backoff for handling network issues.

4. Groq-based Data Extraction

  • Extracts information using a Groq-based language model (e.g., gemma-7b-it).
  • Results are filtered to ensure only meaningful data is returned.

5. React Frontend

  • A React-based frontend provides a clean user interface for file uploads, data preview, prompt input, and results display.
  • Organized output with sections, headings, and bullet points for readability.

Prerequisites

  • Node.js (version >= 14)
  • npm or yarn

Installation

1. Clone the Repository

git clone [email protected]:Dakshya52/AI_Data_Extraction.git

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published