-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathreadme.txt
71 lines (47 loc) · 2.32 KB
/
readme.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
%
% Gaussian-Bernoulli Restricted Boltzmann Machine Using
% Minimum Probability Flow Learning
% Steven Munn
% email: [email protected]
#####
Contents:
1) Quick Start
2) Matrix naming convention
3) Naming Convention Abbreviations
4) Minfunc options
5) Minibatch system
#####
1) Quick Start -----------------------------------
To run any script starting with "GBRBM_main" you will need to,
* download the minFunc scripts at http://www.di.ens.fr/~mschmidt/Software/minFunc.html
* adapt the addpath lines (14, 15, 16) with the correct paths
* change line 54 of GBRBM_main.m to use the learning data you want.
I've included a learning data set 8by8data_W1neg3.mat
The soon to be created repository PMPF data preprocessing will show where this data comes from.
The header comments on each of these scripts contains a more detailed explantion of what they do.
*Before coding:
Read the naming conventions. They are very important for the more mathematically involved scripts like k_dk_grbm.m
2) Naming -----------------------------------
*General variables:
Capitalize first letter of each word and ommit space. Eg.: BurnIn, ImageSize.
*Counter variables:
Begin variable name with n if it stores a total number of iterations value. Eg. nSamples is the total number of samples.
Begin variable name with i if it stores the current iteration value of a for loop. Eg. iSample is the current sample the for loop is iterating through.
*Matrix Variables:
Follow this format: DescriptiveName_XbY
Where X is the number of rows in the matrix, and Y the number of columns using the abbreviations in section 3.
*Functions and file names:
Generally, try to keep all lower case, except for abbreviations. No spaces. Just underscore between words.
3) Naming Convention Abbreviations ------------------------------
H = number of hidden units
V = number of visible units
N = number of training samples
NP = number of training samples times number of PT chains
BS = Batch Size
*Example:
Dall_VbN = A matrix with all the training Data. It has as many rows are there are visible units and as many columns as there are training samples.
4) Common Minfunc options
Helpful for checking the derivative code,
minf_options.DerivativeCheck='on';
5) Minibatch system
Data is truncated.. (GRBM_main line 52)