Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

React flow integration #957

Merged
merged 44 commits into from
Sep 15, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
44 commits
Select commit Hold shift + click to select a range
743b125
react flow tabular dnd init
karkir0003 Jul 9, 2023
08104fd
tabular dnd
karkir0003 Jul 9, 2023
5d93186
Merge branch 'nextjs' of https://github.com/DSGT-DLP/Deep-Learning-Pl…
farisdurrani Jul 15, 2023
6cb2488
test
farisdurrani Jul 15, 2023
c1240dc
importing uselazy
farisdurrani Jul 15, 2023
7942058
adding types to nodes
farisdurrani Jul 15, 2023
cfd9772
Merge branch 'nextjs' of https://github.com/DSGT-DLP/Deep-Learning-Pl…
farisdurrani Jul 19, 2023
b51014a
Generalized html tooltip
farisdurrani Jul 19, 2023
c676bbe
got dnd with start
farisdurrani Jul 19, 2023
3d60d8a
adding params to nodes
farisdurrani Jul 19, 2023
f563697
Merge branch 'nextjs' of https://github.com/DSGT-DLP/Deep-Learning-Pl…
farisdurrani Jul 19, 2023
f6f2f73
adding params to nodes
farisdurrani Jul 19, 2023
f5849ea
Merge branch 'nextjs' of https://github.com/DSGT-DLP/Deep-Learning-Pl…
farisdurrani Jul 21, 2023
69c6897
parameter updating in data
farisdurrani Jul 22, 2023
53a3f41
wrapping of layers
farisdurrani Jul 22, 2023
52933d3
Pulling in changes
farisdurrani Jul 22, 2023
1fd9fc0
export layers function init
farisdurrani Jul 22, 2023
ac097d3
minor aesthetics
farisdurrani Jul 22, 2023
4f256e7
pushing last code
farisdurrani Jul 28, 2023
3930e80
Merge branch 'nextjs' of https://github.com/DSGT-DLP/Deep-Learning-Pl…
farisdurrani Aug 12, 2023
837a507
dummy
farisdurrani Aug 14, 2023
b04d59e
Pulled latest
farisdurrani Aug 25, 2023
6cdd2c0
Minor correction
farisdurrani Aug 25, 2023
563b4b7
Merge branch 'nextjs' of https://github.com/DSGT-DLP/Deep-Learning-Pl…
farisdurrani Sep 1, 2023
4b8637c
pulled
farisdurrani Sep 7, 2023
ebc4f19
function to read layers
farisdurrani Sep 8, 2023
0e34d89
Standardizing default datasets
farisdurrani Sep 8, 2023
2a99dd5
function to read layers
farisdurrani Sep 8, 2023
a8a8e2f
Default layers for Iris
farisdurrani Sep 8, 2023
622d132
Restricted implemented train types
farisdurrani Sep 8, 2023
84585b0
Added DnD to step and reading layers
farisdurrani Sep 8, 2023
1a0cb4e
fixed implemented_da
farisdurrani Sep 12, 2023
5bc2385
Merge branch 'nextjs' of https://github.com/DSGT-DLP/Deep-Learning-Pl…
farisdurrani Sep 12, 2023
3a74c23
minor typo
farisdurrani Sep 13, 2023
43a3fb2
aesthetics for flow
farisdurrani Sep 13, 2023
54de4ab
removed old dnd
farisdurrani Sep 13, 2023
f3a1a29
added nanoid, removed unused code
farisdurrani Sep 13, 2023
a95820b
added ImageFlow
farisdurrani Sep 13, 2023
552db0c
:art: Auto-generated directory tree for repository in Architecture.md
farisdurrani Sep 13, 2023
365c5db
settings.json removed change
farisdurrani Sep 15, 2023
63c18ea
:art: Auto-generated directory tree for repository in Architecture.md
farisdurrani Sep 15, 2023
d83b34d
nit
farisdurrani Sep 15, 2023
edbdf1b
Merge branch 'nextjs' into react-flow-integration-trainspace
farisdurrani Sep 15, 2023
413b7e0
Merge remote-tracking branch 'origin/react-flow-integration-trainspac…
farisdurrani Sep 15, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
276 changes: 140 additions & 136 deletions .github/Architecture.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,218 +4,222 @@

```
📦 backend
| |- 📂 aws_helpers:
| | |- 📂 dynamo_db_utils:
| | | |- 📜 DynamoUnitTests.md
| | | |- 📜 dynamo_db_utils.py
| | | |- 📜 trainspace_db.py
| | | |- 📜 constants.py : list of helpful constants
| | | |- 📜 userprogress_db.py
| | |- 📜 __init__.py
| |- 📂 ml:
| | |- 📜 ml_trainer.py : train a classical machine learning learning model on the dataset
| | |- 📜 __init__.py
| | |- 📜 ml_model_parser.py
| |- 📂 dl:
| | |- 📜 __init__.py
| | |- 📜 dl_model_parser.py : parse the user specified pytorch model
| | |- 📜 dl_trainer.py : train a deep learning model on the dataset
| | |- 📜 __init__.py
| | |- 📜 dl_model.py : torch model based on user specifications from drag and drop
| | |- 📜 dl_model_parser.py : parse the user specified pytorch model
| | |- 📜 detection.py
| | |- 📜 dl_eval.py : Evaluation functions for deep learning models in Pytorch (eg: accuracy, loss, etc)
| |- 📂 ml:
| | |- 📜 ml_trainer.py : train a classical machine learning learning model on the dataset
| | |- 📜 ml_model_parser.py
| | |- 📜 __init__.py
| |- 📂 common:
| | |- 📜 default_datasets.py : store logic to load in default datasets from scikit-learn
| | |- 📜 optimizer.py : what optimizer to use (ie: SGD or Adam for now)
| | |- 📜 dataset.py : read in the dataset through URL or file upload
| | |- 📜 loss_functions.py : loss function enum
| | |- 📜 __init__.py
| | |- 📜 preprocessing.py
| | |- 📜 dataset.py : read in the dataset through URL or file upload
| | |- 📜 constants.py : list of helpful constants
| | |- 📜 optimizer.py : what optimizer to use (ie: SGD or Adam for now)
| | |- 📜 ai_drive.py
| | |- 📜 default_datasets.py : store logic to load in default datasets from scikit-learn
| | |- 📜 utils.py : utility functions that could be helpful
| | |- 📜 email_notifier.py : Endpoint to send email notification of training results via API Gateway + AWS SES
| | |- 📜 loss_functions.py : loss function enum
| | |- 📜 kernel.py
| | |- 📜 utils.py : utility functions that could be helpful
| |- 📜 __init__.py
| |- 📜 middleware.py
| |- 📜 poetry.lock
| |- 📂 aws_helpers:
| | |- 📂 dynamo_db_utils:
| | | |- 📜 DynamoUnitTests.md
| | | |- 📜 dynamo_db_utils.py
| | | |- 📜 constants.py : list of helpful constants
| | | |- 📜 trainspace_db.py
| | | |- 📜 userprogress_db.py
| | |- 📜 __init__.py
| |- 📜 epoch_times.csv
| |- 📜 app.py : run the backend (entrypoint script)
| |- 📜 data.csv : data csv file for use in the playground
| |- 📜 __init__.py
| |- 📜 pyproject.toml
| |- 📜 data.csv : data csv file for use in the playground
| |- 📜 poetry.lock
| |- 📜 middleware.py
```

## Frontend Architecture

```
📦 frontend
| |- 📂 src:
| | |- 📂 backend_outputs:
| | | |- 📜 model.pt : Last model.pt output
| | | |- 📜 my_deep_learning_model.onnx : Last ONNX file output
| | | |- 📜 model.pkl
| | |- 📂 pages:
| | | |- 📂 train:
| | | | |- 📜 [train_space_id].tsx
| | | | |- 📜 index.tsx
| | | |- 📜 feedback.tsx
| | | |- 📜 settings.tsx
| | | |- 📜 _app.tsx
| | | |- 📜 learn.tsx
| | | |- 📜 login.tsx
| | | |- 📜 wiki.tsx
| | | |- 📜 _document.tsx
| | | |- 📜 about.tsx
| | | |- 📜 forgot.tsx
| | | |- 📜 dashboard.tsx
| | | |- 📜 LearnContent.tsx
| | |- 📂 features:
| | | |- 📂 Train:
| | | | |- 📂 constants:
| | | | | |- 📜 trainConstants.ts
| | | | |- 📂 redux:
| | | | | |- 📜 trainspaceSlice.ts
| | | | | |- 📜 trainspaceApi.ts
| | | | |- 📂 features:
| | | | | |- 📂 Image:
| | | | | | |- 📂 constants:
| | | | | | | |- 📜 imageConstants.ts
| | | | | | |- 📂 components:
| | | | | | | |- 📜 ImageTrainspace.tsx
| | | | | | | |- 📜 ImageDatasetStep.tsx
| | | | | | | |- 📜 ImageReviewStep.tsx
| | | | | | | |- 📜 ImageParametersStep.tsx
| | | | | | |- 📂 types:
| | | | | | | |- 📜 imageTypes.ts
| | | | | | |- 📂 redux:
| | | | | | | |- 📜 imageActions.ts
| | | | | | | |- 📜 imageApi.ts
| | | | | | |- 📜 index.ts
| | | | | |- 📂 Tabular:
| | | | | | |- 📂 redux:
| | | | | | | |- 📜 tabularApi.ts
| | | | | | | |- 📜 tabularActions.ts
| | | | | | |- 📂 constants:
| | | | | | | |- 📜 tabularConstants.ts
| | | | | | |- 📂 types:
| | | | | | | |- 📜 tabularTypes.ts
| | | | | | |- 📂 components:
| | | | | | | |- 📜 TabularParametersStep.tsx
| | | | | | | |- 📜 TabularReviewStep.tsx
| | | | | | | |- 📜 TabularDatasetStep.tsx
| | | | | | | |- 📜 TabularParametersStep.tsx
| | | | | | | |- 📜 TabularTrainspace.tsx
| | | | | | | |- 📜 TabularReviewStep.tsx
| | | | | | |- 📂 types:
| | | | | | | |- 📜 tabularTypes.ts
| | | | | | | |- 📜 TabularFlow.tsx
| | | | | | |- 📜 index.ts
| | | | | |- 📂 Image:
| | | | | | |- 📂 redux:
| | | | | | | |- 📜 tabularActions.ts
| | | | | | | |- 📜 tabularApi.ts
| | | | | | | |- 📜 imageActions.ts
| | | | | | | |- 📜 imageApi.ts
| | | | | | |- 📂 constants:
| | | | | | | |- 📜 imageConstants.ts
| | | | | | |- 📂 types:
| | | | | | | |- 📜 imageTypes.ts
| | | | | | |- 📂 components:
| | | | | | | |- 📜 ImageParametersStep.tsx
| | | | | | | |- 📜 ImageFlow.tsx
| | | | | | | |- 📜 ImageTrainspace.tsx
| | | | | | | |- 📜 ImageReviewStep.tsx
| | | | | | | |- 📜 ImageDatasetStep.tsx
| | | | | | |- 📜 index.ts
| | | | |- 📂 components:
| | | | | |- 📜 CreateTrainspace.tsx
| | | | | |- 📜 DatasetStepLayout.tsx
| | | | | |- 📜 TrainspaceLayout.tsx
| | | | |- 📂 constants:
| | | | | |- 📜 trainConstants.ts
| | | | |- 📂 types:
| | | | | |- 📜 trainTypes.ts
| | | | |- 📂 redux:
| | | | | |- 📜 trainspaceApi.ts
| | | | | |- 📜 trainspaceSlice.ts
| | | |- 📂 Dashboard:
| | | | |- 📂 components:
| | | | | |- 📜 TrainDoughnutChart.tsx
| | | | | |- 📜 TrainBarChart.tsx
| | | | | |- 📜 TrainDataGrid.tsx
| | | | | |- 📜 TrainspaceLayout.tsx
| | | | | |- 📜 DatasetStepLayout.tsx
| | | | | |- 📜 CreateTrainspace.tsx
| | | |- 📂 Feedback:
| | | | |- 📂 redux:
| | | | | |- 📜 dashboardApi.ts
| | | | | |- 📜 feedbackApi.ts
| | | |- 📂 OpenAi:
| | | | |- 📜 openAiUtils.ts
| | | |- 📂 LearnMod:
| | | | |- 📜 LearningModulesContent.tsx
| | | | |- 📜 Exercise.tsx
| | | | |- 📜 ImageComponent.tsx
| | | | |- 📜 ModulesSideBar.tsx
| | | | |- 📜 ImageComponent.tsx
| | | | |- 📜 MCQuestion.tsx
| | | | |- 📜 FRQuestion.tsx
| | | | |- 📜 ClassCard.tsx
| | | |- 📂 Feedback:
| | | | |- 📜 FRQuestion.tsx
| | | | |- 📜 Exercise.tsx
| | | | |- 📜 LearningModulesContent.tsx
| | | |- 📂 Dashboard:
| | | | |- 📂 redux:
| | | | | |- 📜 feedbackApi.ts
| | | |- 📂 OpenAi:
| | | | |- 📜 openAiUtils.ts
| | | | | |- 📜 dashboardApi.ts
| | | | |- 📂 components:
| | | | | |- 📜 TrainDoughnutChart.tsx
| | | | | |- 📜 TrainDataGrid.tsx
| | | | | |- 📜 TrainBarChart.tsx
| | |- 📂 common:
| | | |- 📂 redux:
| | | | |- 📜 backendApi.ts
| | | | |- 📜 userLogin.ts
| | | | |- 📜 train.ts
| | | | |- 📜 store.ts
| | | | |- 📜 hooks.ts
| | | |- 📂 styles:
| | | | |- 📜 globals.css
| | | | |- 📜 Home.module.css
| | | |- 📂 components:
| | | | |- 📜 ClientOnlyPortal.tsx
| | | | |- 📜 EmailInput.tsx
| | | | |- 📜 TitleText.tsx
| | | | |- 📜 NavBarMain.tsx
| | | | |- 📜 Footer.tsx
| | | | |- 📜 Spacer.tsx
| | | | |- 📜 HtmlTooltip.tsx
| | | | |- 📜 TitleText.tsx
| | | | |- 📜 DlpTooltip.tsx
| | | | |- 📜 Footer.tsx
| | | |- 📂 utils:
| | | | |- 📜 dndHelpers.ts
| | | | |- 📜 firebase.ts
| | | | |- 📜 dateFormat.ts
| | | | |- 📜 dndHelpers.ts
| | | |- 📂 redux:
| | | | |- 📜 backendApi.ts
| | | | |- 📜 userLogin.ts
| | | | |- 📜 hooks.ts
| | | | |- 📜 store.ts
| | | | |- 📜 train.ts
| | |- 📂 pages:
| | | |- 📂 train:
| | | | |- 📜 [train_space_id].tsx
| | | | |- 📜 index.tsx
| | | |- 📜 _document.tsx
| | | |- 📜 dashboard.tsx
| | | |- 📜 _app.tsx
| | | |- 📜 LearnContent.tsx
| | | |- 📜 forgot.tsx
| | | |- 📜 learn.tsx
| | | |- 📜 settings.tsx
| | | |- 📜 feedback.tsx
| | | |- 📜 about.tsx
| | | |- 📜 login.tsx
| | | |- 📜 wiki.tsx
| | |- 📂 backend_outputs:
| | | |- 📜 model.pkl
| | | |- 📜 model.pt : Last model.pt output
| | | |- 📜 my_deep_learning_model.onnx : Last ONNX file output
| | |- 📜 iris.csv : Sample CSV data
| | |- 📜 next-env.d.ts
| | |- 📜 constants.ts
| | |- 📜 GlobalStyle.ts
| |- 📂 layer_docs:
| | |- 📜 Linear.md : Doc for Linear layer
| | |- 📜 Softmax.md : Doc for Softmax layer
| | |- 📜 softmax_equation.png : PNG file of Softmax equation
| | |- 📜 ReLU.md : Doc for ReLU later
| | |- 📜 next-env.d.ts
| |- 📂 public:
| | |- 📂 images:
| | | |- 📂 wiki_images:
| | | | |- 📜 maxpool2d.gif
| | | | |- 📜 tanh_plot.png
| | | | |- 📜 avgpool_maxpool.gif
| | | | |- 📜 batchnorm_diagram.png
| | | | |- 📜 softmax_equation.png : PNG file of Softmax equation
| | | | |- 📜 conv2d.gif
| | | | |- 📜 conv2d2.gif
| | | | |- 📜 tanh_equation.png
| | | | |- 📜 dropout_diagram.png
| | | | |- 📜 sigmoid_equation.png
| | | |- 📂 learn_mod_images:
| | | | |- 📜 ReLUactivation.png
| | | | |- 📜 binarystepactivation.png
| | | | |- 📜 lossExampleEquation.png
| | | | |- 📜 sigmoidactivation.png
| | | | |- 📜 sigmoidfunction.png
| | | | |- 📜 robotImage.jpg
| | | | |- 📜 lossExample.png
| | | | |- 📜 lossExampleTable.png
| | | | |- 📜 neuronWithEquation.png
| | | | |- 📜 LeakyReLUactivation.png
| | | | |- 📜 neuron.png
| | | | |- 📜 neuralnet.png
| | | | |- 📜 tanhactivation.png
| | | |- 📂 logos:
| | | | |- 📂 dlp_branding:
| | | | | |- 📜 dlp-logo.svg : DLP Logo, duplicate of files in public, but essential as the frontend can't read public
| | | | | |- 📜 dlp-logo.png : DLP Logo, duplicate of files in public, but essential as the frontend can't read public
| | | | |- 📜 dsgt-logo-dark.png
| | | | |- 📜 github.png
| | | | |- 📜 dsgt-logo-light.png
| | | | |- 📜 pandas-logo.png
| | | | |- 📜 react-logo.png
| | | | |- 📜 google.png
| | | | |- 📜 python-logo.png
| | | | |- 📜 dsgt-logo-white-back.png
| | | | |- 📜 pandas-logo.png
| | | | |- 📜 aws-logo.png
| | | | |- 📜 flask-logo.png
| | | | |- 📜 react-logo.png
| | | | |- 📜 dsgt-logo-light.png
| | | | |- 📜 pytorch-logo.png
| | | | |- 📜 aws-logo.png
| | | | |- 📜 google.png
| | | | |- 📜 dsgt-logo-white-back.png
| | | |- 📂 learn_mod_images:
| | | | |- 📜 lossExampleTable.png
| | | | |- 📜 tanhactivation.png
| | | | |- 📜 sigmoidactivation.png
| | | | |- 📜 LeakyReLUactivation.png
| | | | |- 📜 ReLUactivation.png
| | | | |- 📜 robotImage.jpg
| | | | |- 📜 lossExample.png
| | | | |- 📜 binarystepactivation.png
| | | | |- 📜 lossExampleEquation.png
| | | | |- 📜 neuronWithEquation.png
| | | | |- 📜 neuron.png
| | | | |- 📜 neuralnet.png
| | | | |- 📜 sigmoidfunction.png
| | | |- 📂 wiki_images:
| | | | |- 📜 avgpool_maxpool.gif
| | | | |- 📜 conv2d2.gif
| | | | |- 📜 dropout_diagram.png
| | | | |- 📜 batchnorm_diagram.png
| | | | |- 📜 tanh_plot.png
| | | | |- 📜 softmax_equation.png : PNG file of Softmax equation
| | | | |- 📜 maxpool2d.gif
| | | | |- 📜 tanh_equation.png
| | | | |- 📜 conv2d.gif
| | | | |- 📜 sigmoid_equation.png
| | | |- 📜 demo_video.gif : GIF tutorial of a simple classification training session
| | |- 📜 dlp-logo.ico : DLP Logo
| | |- 📜 dlp-logo.svg : DLP Logo, duplicate of files in public, but essential as the frontend can't read public
| | |- 📜 robots.txt
| | |- 📜 index.html : Base HTML file that will be initially rendered
| | |- 📜 dlp-logo.png : DLP Logo, duplicate of files in public, but essential as the frontend can't read public
| | |- 📜 manifest.json : Default React file for choosing icon based on
| | |- 📜 index.html : Base HTML file that will be initially rendered
| | |- 📜 dlp-logo.ico : DLP Logo
| | |- 📜 robots.txt
| |- 📂 layer_docs:
| | |- 📜 Softmax.md : Doc for Softmax layer
| | |- 📜 Linear.md : Doc for Linear layer
| | |- 📜 softmax_equation.png : PNG file of Softmax equation
| | |- 📜 ReLU.md : Doc for ReLU later
| |- 📜 .eslintrc.json
| |- 📜 .eslintignore
| |- 📜 package.json
| |- 📜 jest.config.js
| |- 📜 .eslintrc.json
| |- 📜 tsconfig.json
| |- 📜 next.config.js
| |- 📜 yarn.lock
| |- 📜 .eslintignore
| |- 📜 next-env.d.ts
| |- 📜 next.config.js
```

Loading
Loading