Skip to content

Commit

Permalink
Update Bibliographie.qmd
Browse files Browse the repository at this point in the history
  • Loading branch information
malo-adler authored Oct 22, 2024
1 parent c9c99f2 commit 27f60d3
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions Bibliographie.qmd
Original file line number Diff line number Diff line change
Expand Up @@ -31,13 +31,16 @@ title: Bibliographie

- [Papier original **'Attention Is All You Need'**](https://arxiv.org/abs/1706.03762)
- [Explication illustrée et très détaillée](http://jalammar.github.io/illustrated-transformer/)
- [Les différents types de modèles](https://medium.com/artificial-corner/discovering-llm-structures-decoder-only-encoder-only-or-decoder-encoder-5036b0e9e88)
- [Les Mixture of Experts](https://huggingface.co/blog/moe)

**Fine-tuning**

- [LoRA](https://arxiv.org/abs/2106.09685)
- [QLoRA](https://arxiv.org/abs/2305.14314)
- [DoRA](https://arxiv.org/abs/2402.09353)

- [Introduction au RLHF](https://huggingface.co/blog/rlhf)
- [DPO](https://arxiv.org/abs/2305.18290)
- [KTO](https://arxiv.org/abs/2402.01306)

Expand Down

0 comments on commit 27f60d3

Please sign in to comment.