Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DeepNetworkTrainingRBM #265

Open
dry11orange opened this issue Feb 24, 2019 · 2 comments
Open

DeepNetworkTrainingRBM #265

dry11orange opened this issue Feb 24, 2019 · 2 comments

Comments

@dry11orange
Copy link

win7 64
Shark-4.0.1
DeepNetworkTrainingRBM

I change the flag_rbm, test error(0.26, 0.06) will change a lot, And they don't have relation at all.
How could this happen?

DeepNetworkTrainingRBM.txt

@Ulfgard
Copy link
Member

Ulfgard commented Feb 24, 2019

could you tell me exactly what you a) do b) observe and c) what you expect the output to be?

@dry11orange
Copy link
Author

I tried to determine the application scenarios for RBM
And whether RBM has irreplaceable characteristics compared with neural network

In the test code DeepNetworkTrainingRBM
I commented out the RBM part, trying to compare the training effect of neural network without RBM

And then I was surprised
Cut off the connection between RBM and neural network
RBM still has an influence on the training results of neural network
Training error 0.26->0.06

Logically speaking
The hyper-parameter configuration of neural network is not good, which may lead to high training error
It should not be associated with irrelevant RBM
Because of this, I am not sure whether the neural network hyper-parameter need to be adjusted

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants