Skip to content

Releases: maxjcohen/transformer

Default pe_period to None

23 Sep 14:52
Compare
Choose a tag to compare
Pre-release

When using original or no Positional Encoding, pe_period should not have a default value. When using regular PE, the pe_period parameter must now be explicitly given.

Attention window

31 Jan 14:55
Compare
Choose a tag to compare

Add an attention window, as a rectangular window on the attention scores. The aim is to help the network focus on local patterns, without affecting the attention scores themselves.

Time length independance

07 Jan 20:40
Compare
Choose a tag to compare

This new version restructure the package (file renaming, extra feature removing) and makes Transformer able to compute on arbitrary long time sequences.

Initial release

04 Jan 15:35
Compare
Choose a tag to compare
v0.1.0

Add package install scripts