This project is a Minimum Viable Product (MVP) designed for a federal initiative, aimed at creating a cloud-based shared drive solution similar to Google Drive. The goal is to enable synchronization across various locations and the cloud, utilizing the Conduit Binary and Python without any additional libraries.
- Cloud Synchronization: Seamlessly sync files and data across multiple locations.
- User-Friendly Interface: Designed for ease of use, allowing users to manage their files effortlessly.
- Robust API Integration: Utilizes the Conduit platform for creating and managing pipelines and connectors.
The project is structured around the following components:
- Pipelines: Define the data flow between different sources and destinations.
- Connectors: Facilitate the connection between the pipelines and the data sources/destinations.
- Audit Logging: Tracks the creation, modification, and deletion of pipelines and connectors for accountability.
- Python 3.x
- Conduit platform
-
Clone the repository:
git clone [email protected]:tsinghgill/multi-pipeline-example.git cd multi-pipeline-example
-
Add a sample pipeline to the pipelines.csv, this will represent a service ticket into ServiceNow for the MVP:
A,A_owner,B_owner,A-to-B,Moves-from-A-to-B,A-to-B_source,tenant-a-demo,Tenant-B-Relationship/Out-to-Tenant-B,A-to-B_destination,tenant-b-demo,Tenant-A-Relationship/In-from-Tenant-A,json- Run the conduit binary. For more information on getting the latest conduit binary, visit the conduit docs: https://conduit.io/docs/
