Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Worker To Worker Communication #342

Merged
merged 67 commits into from
May 22, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
67 commits
Select commit Hold shift + click to select a range
3d51abc
Merge pull request #305 from leondavi/AzureExperiment
leondavi Apr 18, 2024
7b58660
[W2WComm] Updates
GuyPerets106 May 7, 2024
dc7a2b8
Merge branch 'master' of github.com:leondavi/NErlNet into w2wcom
GuyPerets106 May 7, 2024
9a4b86c
Merge branch 'master' of github.com:leondavi/NErlNet into w2wcom
GuyPerets106 May 11, 2024
1829d85
[W2W_Com] Added handle_w2w_msg function in clientStatem at all states
GuyPerets106 May 11, 2024
c5e594a
Merge branch 'master' of github.com:leondavi/NErlNet into w2wcom
GuyPerets106 May 16, 2024
443bf77
Merge branch 'master' of github.com:leondavi/NErlNet into w2wcom
GuyPerets106 May 16, 2024
b034461
[W2W] Fed Exp Jsons
GuyPerets106 May 16, 2024
ea4814b
Merge branch 'w2wcom' of github.com:leondavi/NErlNet into w2wcom
GuyPerets106 May 16, 2024
7e9b716
[W2W] WIP
GuyPerets106 May 16, 2024
c0b26f9
Merge branch 'master' of github.com:leondavi/NErlNet into w2wcom
GuyPerets106 May 16, 2024
d01c874
[W2W] WIP
GuyPerets106 May 16, 2024
1e5faba
Merge branch 'master' of github.com:leondavi/NErlNet into w2wcom
GuyPerets106 May 17, 2024
83937d5
Merge branch 'master' of github.com:leondavi/NErlNet into w2wcom
GuyPerets106 May 17, 2024
76636d8
[W2W] Updated Jsons
GuyPerets106 May 17, 2024
ecdd031
Merge branch 'w2wcom' of github.com:leondavi/NErlNet into w2wcom
GuyPerets106 May 17, 2024
1b11d14
Merge branch 'master' of github.com:leondavi/NErlNet into w2wcom
GuyPerets106 May 17, 2024
5dc9e12
Merge branch 'w2wcom' of github.com:leondavi/NErlNet into w2wcom
GuyPerets106 May 17, 2024
388823f
Merge branch 'master' of github.com:leondavi/NErlNet into w2wcom
GuyPerets106 May 19, 2024
359f5ef
[W2W] Independent Exp Works
GuyPerets106 May 19, 2024
086d0e7
Merge branch 'master' of github.com:leondavi/NErlNet into w2wcom
GuyPerets106 May 19, 2024
e368d93
Merge branch 'w2wcom' of github.com:leondavi/NErlNet into w2wcom
GuyPerets106 May 19, 2024
42868f8
[W2W] Added DC Dist_Fed Json
GuyPerets106 May 19, 2024
1a67f1a
[W2W] Testing Distributed
GuyPerets106 May 19, 2024
c62b37b
[W2W] Added start/end_stream messages
GuyPerets106 May 20, 2024
d6cd1c3
[W2W] WIP
GuyPerets106 May 20, 2024
895ff6e
[W2W] WIP
GuyPerets106 May 20, 2024
dc7fe28
[W2W] Distributed Exp WIP
GuyPerets106 May 20, 2024
8d8d481
[W2W] WIP
GuyPerets106 May 20, 2024
8c603ce
[W2W] WIP
GuyPerets106 May 20, 2024
c9f5b05
[W2W] WIP
GuyPerets106 May 20, 2024
41dbd1b
[W2W] WIP
GuyPerets106 May 20, 2024
8980028
[W2W] WIP
GuyPerets106 May 21, 2024
4c78db8
[W2W] Fixed bugs
GuyPerets106 May 21, 2024
aa377a3
[W2W] Fixed bugs
GuyPerets106 May 21, 2024
f8aed90
[W2W] Fixed bugs
GuyPerets106 May 21, 2024
08bd7cb
[W2W] Fixed bugs
GuyPerets106 May 21, 2024
9e3bf02
[W2W] Fixed bugs
GuyPerets106 May 21, 2024
daaf969
[W2W] Fixed bugs
GuyPerets106 May 21, 2024
37ddd83
[W2W] Fixed bugs
GuyPerets106 May 21, 2024
d82f984
[W2W] Predict phase update
GuyPerets106 May 21, 2024
adcf220
[W2W] Fix bug
GuyPerets106 May 21, 2024
6f6e787
[W2W] Done
GuyPerets106 May 21, 2024
4960724
[W2W] Fixed averaging
GuyPerets106 May 21, 2024
d5d1c9d
[W2W] WIP
GuyPerets106 May 22, 2024
2f508c6
[W2W] WIP
GuyPerets106 May 22, 2024
d07e62c
[W2W] WIP
GuyPerets106 May 22, 2024
32352fe
[W2W] WIP
GuyPerets106 May 22, 2024
efe20f3
[W2W] WIP
GuyPerets106 May 22, 2024
7f05668
[W2W] Added worker_done
GuyPerets106 May 22, 2024
41cf536
[W2W] Fixed var
GuyPerets106 May 22, 2024
da5b977
[W2W] Fixed var
GuyPerets106 May 22, 2024
064970b
[W2W] Test
GuyPerets106 May 22, 2024
eef1d02
[W2W] Test
GuyPerets106 May 22, 2024
4aec2d8
[W2W] Test
GuyPerets106 May 22, 2024
b3845ec
[W2W] WIP
GuyPerets106 May 22, 2024
70a3573
[W2W] WIP
GuyPerets106 May 22, 2024
c06cada
[W2W] WIP
GuyPerets106 May 22, 2024
55070ab
[W2W] WIP
GuyPerets106 May 22, 2024
269225f
[W2W] WIP
GuyPerets106 May 22, 2024
f8270e3
[W2W] WIP
GuyPerets106 May 22, 2024
2a04137
[W2W] WIP
GuyPerets106 May 22, 2024
f4ae9f0
[W2W] WIP
GuyPerets106 May 22, 2024
40b1dfa
[W2W] Test
GuyPerets106 May 22, 2024
f817368
[W2W] Fixed end_stream while state wait
GuyPerets106 May 22, 2024
a580638
[W2W] Done
GuyPerets106 May 22, 2024
35cc41e
[W2W] Done
GuyPerets106 May 22, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
{
"connectionsMap":
{
"r1":["mainServer", "r2" , "c2" , "r3"],
"r2":["r1", "s1" , "c1" , "r3"],
"r3":["r1", "r2" , "s2" , "c3"]
}
}
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
{
"connectionsMap":
{
"r1":["mainServer", "r2" , "c2"],
"r2":["r1", "s1" , "c1"]
}
}
67 changes: 67 additions & 0 deletions inputJsonsFiles/DistributedConfig/dc_AEC_1d_2c_1s_4r_4w.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,67 @@
{
"nerlnetSettings": {
"frequency": "200",
"batchSize": "100"
},
"mainServer": {
"port": "8081",
"args": ""
},
"apiServer": {
"port": "8082",
"args": ""
},
"devices": [
{
"name": "pc1",
"ipv4": "10.211.55.3",
"entities": "c1,c2,r2,r1,r3,r4,s1,apiServer,mainServer"
}
],
"routers": [
{
"name": "r1",
"port": "8086",
"policy": "0"
},
{
"name": "r2",
"port": "8087",
"policy": "0"
},
{
"name": "r3",
"port": "8088",
"policy": "0"
},
{
"name": "r4",
"port": "8089",
"policy": "0"
}
],
"sources": [
{
"name": "s1",
"port": "8085",
"frequency": "200",
"policy": "0",
"epochs": "1",
"type": "0"
}
],
"clients": [
{
"name": "c1",
"port": "8083",
"workers": ""
},
{
"name": "c2",
"port": "8084",
"workers": ""
}
],
"workers": [],
"model_sha": {}
}
143 changes: 143 additions & 0 deletions inputJsonsFiles/DistributedConfig/dc_dist_2d_3c_2s_3r_6w.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,143 @@
{
"nerlnetSettings": {
"frequency": "100",
"batchSize": "100"
},
"mainServer": {
"port": "8900",
"args": ""
},
"apiServer": {
"port": "8901",
"args": ""
},
"devices": [
{
"name": "c0vm0",
"ipv4": "10.0.0.5",
"entities": "mainServer,c1,c2,r1,r2,s1,apiServer"
},
{
"name": "c0vm1",
"ipv4": "10.0.0.4",
"entities": "c3,r3,s2"
}
],
"routers": [
{
"name": "r1",
"port": "8905",
"policy": "0"
},
{
"name": "r2",
"port": "8906",
"policy": "0"
},
{
"name": "r3",
"port": "8901",
"policy": "0"
}
],
"sources": [
{
"name": "s1",
"port": "8904",
"frequency": "200",
"policy": "0",
"epochs": "1",
"type": "0"
},
{
"name": "s2",
"port": "8902",
"frequency": "200",
"policy": "0",
"epochs": "1",
"type": "0"
}
],
"clients": [
{
"name": "c1",
"port": "8902",
"workers": "w1,w2,ws"
},
{
"name": "c2",
"port": "8903",
"workers": "w3,w4"
},
{
"name": "c3",
"port": "8900",
"workers": "w5,w6"
}
],
"workers": [
{
"name": "w1",
"model_sha": "0771693392e898393c9b2b8235497537b5fbed1fd0c9a5a7ec6aab665d2c1896"
},
{
"name": "w2",
"model_sha": "0771693392e898393c9b2b8235497537b5fbed1fd0c9a5a7ec6aab665d2c1896"
},
{
"name": "ws",
"model_sha": "0771693392e898393c9b2b8235497537b5fbed1fd0c9a5a7ec6aab665d2c1896"
},
{
"name": "w3",
"model_sha": "0771693392e898393c9b2b8235497537b5fbed1fd0c9a5a7ec6aab665d2c1896"
},
{
"name": "w4",
"model_sha": "0771693392e898393c9b2b8235497537b5fbed1fd0c9a5a7ec6aab665d2c1896"
},
{
"name": "w5",
"model_sha": "0771693392e898393c9b2b8235497537b5fbed1fd0c9a5a7ec6aab665d2c1896"
},
{
"name": "w6",
"model_sha": "0771693392e898393c9b2b8235497537b5fbed1fd0c9a5a7ec6aab665d2c1896"
}
],
"model_sha": {
"0771693392e898393c9b2b8235497537b5fbed1fd0c9a5a7ec6aab665d2c1896": {
"modelType": "0",
"_doc_modelType": " nn:0 | approximation:1 | classification:2 | forecasting:3 | image_classification:4 | text_classification:5 | text_generation:6 | auto_association:7 | autoencoder:8 | ae_classifier:9 |",
"modelArgs": "",
"_doc_modelArgs": "Extra arguments to model",
"layersSizes": "5,6,6,4,3",
"_doc_layersSizes": "List of postive integers [L0, L1, ..., LN]",
"layerTypesList": "1,3,3,3,3",
"_doc_LayerTypes": " Default:0 | Scaling:1 | Conv:2 | Perceptron:3 | Pooling:4 | Probabilistic:5 | LSTM:6 | Reccurrent:7 | Unscaling:8 | Flatten:9 | Bounding:10 |",
"layers_functions": "1,8,8,8,11",
"_doc_layers_functions_activation": " Threshold:1 | Sign:2 | Logistic:3 | Tanh:4 | Linear:5 | ReLU:6 | eLU:7 | SeLU:8 | Soft-plus:9 | Soft-sign:10 | Hard-sigmoid:11 |",
"_doc_layer_functions_pooling": " none:1 | Max:2 | Avg:3 |",
"_doc_layer_functions_probabilistic": " Binary:1 | Logistic:2 | Competitive:3 | Softmax:4 |",
"_doc_layer_functions_scaler": " none:1 | MinMax:2 | MeanStd:3 | STD:4 | Log:5 |",
"lossMethod": "2",
"_doc_lossMethod": " SSE:1 | MSE:2 | NSE:3 | MinkowskiE:4 | WSE:5 | CEE:6 |",
"lr": "0.001",
"_doc_lr": "Positve float",
"epochs": "1",
"_doc_epochs": "Positve Integer",
"optimizer": "5",
"_doc_optimizer": " GD:0 | CGD:1 | SGD:2 | QuasiNeuton:3 | LVM:4 | ADAM:5 |",
"optimizerArgs": "none",
"_doc_optimizerArgs": "String",
"infraType": "0",
"_doc_infraType": " opennn:0 | wolfengine:1 |",
"distributedSystemType": "0",
"_doc_distributedSystemType": " none:0 | fedClientAvg:1 | fedServerAvg:2 |",
"distributedSystemArgs": "SyncMaxCount=10",
"_doc_distributedSystemArgs": "String",
"distributedSystemToken": "9922u",
"_doc_distributedSystemToken": "Token that associates distributed group of workers and parameter-server"
}
}
}
Loading