This project uses advanced data engineering approaches to streamline data processing and enhance predictive analytics capabilities. By leveraging cutting-edge algorithms and scalable infrastructure, it aims to increase the flexibility on finding perfect electrical vehicle.
The main problem is the lack of the public awareness to educate people about the benefits of EVs (Electric Vehicles), charging infrastructure and effeciency on price, emission control and lots more advantages.
This analytics reduce the following challanges.
- Increase public awareness: Educate people about the benefits of EVs, such as reduced emissions and lower running costs. This can address range anxiety (fear of running out of battery) and encourage adoption.
- Expand charging infrastructure: Build more charging stations, especially fast-charging stations, to reduce charging time and make long-distance travel with EVs more convenient.
- Provide incentives: Offer tax breaks, rebates, or other financial incentives for purchasing or leasing EVs. This can offset the higher upfront cost compared to traditional gasoline vehicles.
- Develop efficient battery technology: Research and development of batteries with longer range and shorter charging times can significantly improve the practicality of EVs.
By addressing these challenges, we can encourage more people to switch to EVs and reduce reliance on fossil fuels, leading to a cleaner environment.
[email protected]:bkglobal/Data_engineering_project_electric_vehicle_population.git
cd Data_engineering_project_electric_vehicle_population
Rename dev.env
to .env
mv dev.env .env
Add your kaggle credentials to the following variables.
KAGGLE_USERNAME=<Kaggle_username>
KAGGLE_API_TOKEN=<Kaggle_token>
Add GCP Key file to folder data-ingestion/gcp_credentials/key.json
The project containg two parts which needs to run using Docker.
- Data Ingestion
- Data Analytics
It is using Mage with Postgres Database.
Go to Data Ingestion Folder.
cd data-ingestion
Start the Docker containers using docker-compose.yml
file:
docker compose up
For running containers on background
docker compose up -d
It is using metabase.
Go to the Data Analytics Folder
cd data-analytics
Start the Docker containers using docker-compose.yml
file:
docker compose up
For running containers on background
docker compose up -d