Skip to content

MinimalGPT v2.0.0

Latest
Compare
Choose a tag to compare
@abhaskumarsinha abhaskumarsinha released this 01 Aug 18:40
· 1 commit to main since this release
4048e22

MinimalGPT v2.0.0 includes:

  • Loading very large-sized files/datasets in the form of memory chunks.
  • CPU/GPU/TPU Training support.
  • OpenAI styled Multihead Attention implementation as well as classic Transformer Attention
  • Table to check GPT Model components as well as number of parameters in each component.