Plagiarism Detector, Machine Learning Deployment

This repository contains code and associated files for deploying a plagiarism detector using AWS SageMaker.

Project Overview

This project is broken down into three main notebooks:

Notebook 1: Data Exploration

• Load in the corpus of plagiarism text data.
• Explore the existing data features and the data distribution.

Notebook 2: Feature Engineering

• Clean and pre-process the text data.
• Define features for comparing the similarity of an answer text and a source text, and extract similarity features.
• Select "good" features, by analyzing the correlations between different features.
• Create train/test .csv files that hold the relevant features and class labels for train/test data points.

Notebook 3: Train and Deploy Your Model in SageMaker

• Upload the train/test feature data to S3.
• Define a binary classification model and a training script.
• Train the model and deploy it using SageMaker.
• Evaluate the deployed classifier.