Skip to content
This repository was archived by the owner on Jan 3, 2023. It is now read-only.

[WIP]Langjian/mlsl #384

Open
wants to merge 24 commits into
base: master
Choose a base branch
from
Open
Changes from 1 commit
Commits
Show all changes
24 commits
Select commit Hold shift + click to select a range
3878e43
Fix new klocwork error reports on 11/20/2018
jianyinglang Nov 21, 2018
4decf57
Fix the FusedBatchNorm with the Bessel correction in variance
jianyinglang Dec 4, 2018
cfb0a83
Fix the format
jianyinglang Dec 4, 2018
76ab3fa
Merge remote-tracking branch 'origin/master' into langjian/BatchNorm_…
jianyinglang Dec 4, 2018
289a43d
Add distributed macro
jianyinglang Dec 4, 2018
2163ac1
Add multi-node .json file output
jianyinglang Dec 6, 2018
34c4ddf
Merge remote-tracking branch 'origin/master' into langjian/distribute…
jianyinglang Dec 6, 2018
2e70b97
Change CMake file to be consistent with master
jianyinglang Dec 6, 2018
1c34c3d
Format change
jianyinglang Dec 6, 2018
70449be
Add a simple distributed mnist model
jianyinglang Dec 10, 2018
5ea9070
Merge remote-tracking branch 'origin/master' into langjian/distribute…
jianyinglang Dec 19, 2018
73cf9d0
Add distributed option for Makefile
jianyinglang Dec 19, 2018
2c594ee
modify distributed example
jianyinglang Dec 19, 2018
d788247
Add distributed flags for multi-process graph dumps
jianyinglang Dec 20, 2018
0371935
Changes the Makefile to enable distributed build
jianyinglang Dec 21, 2018
d16f2d9
Merge remote-tracking branch 'origin/master' into langjian/distribute…
jianyinglang Dec 21, 2018
f205cb2
Format fix
jianyinglang Dec 21, 2018
0ecd43b
Fix the typo and delete debug comment and add run command
jianyinglang Dec 21, 2018
100c129
Fix the python file format
jianyinglang Dec 21, 2018
dda11aa
Fix python file format
jianyinglang Dec 21, 2018
6caf977
Add mnist data directory
jianyinglang Dec 21, 2018
c32b389
Integrate with mlsl
jianyinglang Dec 27, 2018
6625841
Merge remote-tracking branch 'origin/master' into langjian/MLSL
jianyinglang Dec 27, 2018
f0a94fb
Integrate with MLSL
jianyinglang Dec 28, 2018
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Add mnist data directory
jianyinglang committed Dec 21, 2018
commit 6caf97782d3acd7861ca672aaba0fd2f5432faf1
3 changes: 1 addition & 2 deletions examples/mnist/mnist_softmax_distributed.py
Original file line number Diff line number Diff line change
@@ -45,7 +45,6 @@ def run_mnist(_):
# Import data
mnist = learn.datasets.mnist.read_data_sets(
FLAGS.data_dir + 'MNIST-data-%d' % hvd.rank(), one_hot=True)
#mnist = input_data.read_data_sets(FLAGS.data_dir, one_hot=True)

# Create the model
with tf.name_scope("mnist_placholder"):
@@ -139,4 +138,4 @@ def run_mnist(_):
FLAGS, unparsed = parser.parse_known_args()
tf.app.run(main=main, argv=[sys.argv[0]] + unparsed)
# run comand for this distributed script
# mpirun -np 2 python mnist_softmax_distributed.py
# mpirun -np 2 python mnist_softmax_distributed.py --data_dir=/mnt/data/mnist