This repository has been archived by the owner on Nov 17, 2023. It is now read-only.
Replies: 3 comments
-
@mxnet-label-bot add [KVStore, Feature request, Question] |
Beta Was this translation helpful? Give feedback.
0 replies
-
Yes! I am also thinking about doing this. I am curious - what's your use case? |
Beta Was this translation helpful? Give feedback.
0 replies
-
I want to implement the optimizer described in the paper "Sparse Communication for Distributed Gradient Descent" , available at https://arxiv.org/abs/1704.05021 I tried to modify the value of NDArray directly through index, but it was a bit slow. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Description
In distributed training, communication takes up a lot of time. In order to compress the communication time, an optimization method is to make the gradient sparse.
But for now kv_store doesn't support push CSRNDArray values.
Although support for this feature may cause other problems, right?
For example, for CSRNDArray format
But kv_store probably transfers multidimensional arrays
Beta Was this translation helpful? Give feedback.
All reactions