Question about the formula calculating c value

[ghost]

In the paper,

what does this formula mean? softmax gives a vector and h_i is also a vector. what does mulitplication of softmax and h_I means?

[ChanganVR]

hi @guldamkwak3114 we meant to normalize the scores alpha_i and do weighted sum of all h_i. Sorry for the bad and confusing writing.

[ghost]

What do you mean by normalize the scores alpha_i ?

[ChanganVR]

Softmax is the normalization operation.

[ghost]

Still confuse me. softmax(alpha_i) and h_i are both vectors.................... how can we multiply them?

[ghost]

do you mean dot product of softmax(alpha_i) and h_i ?

[ChanganVR]

The softmax(alpha_i) here means doing softmax for all scores and take the ith component, which is just a single value. So we normalize the score with softmax for all neighbors and do a weighted sum of each neighbor's interaction feature.

[ghost]

alpha_i itself is a vector. then do you mean take softmax of (a_1,a_2, .... ,a_n) and get the i-th component?

Thanks

[ChanganVR]

Is alpha_i a vecotr? alpha_i is the score for each pair right?

take softmax of (a_1,a_2, .... ,a_n) and get the i-th component?
This is right.

[ghost]

according to this alpha_i should be length 100 vector. Am i miss-reading something?

[ChanganVR]

The hidden units refers to all the MLP layers up to but not including the last layer. The last layer outputs one single value for each pair/human as the attention score. The corresponding code:

CrowdNav/crowd_nav/policy/sarl.py

Line 48 in 503173b

scores = self.attention(attention_input).view(size[0], size[1], 1).squeeze(dim=2)