-
Notifications
You must be signed in to change notification settings - Fork 2
/
Bibliographie.qmd
67 lines (43 loc) · 2.49 KB
/
Bibliographie.qmd
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
---
title: Bibliographie
---
## I - Accompagnement
### Généralité
- [Qu'est ce que l'IA ?](https://www.technologyreview.com/2024/07/10/1094475/what-is-artificial-intelligence-ai-definitive-guide/)
- [What We Learned from a Year of Building with LLMs (Part I)](https://www.oreilly.com/radar/what-we-learned-from-a-year-of-building-with-llms-part-i/)
- [What We Learned from a Year of Building with LLMs (Part II)](https://www.oreilly.com/radar/what-we-learned-from-a-year-of-building-with-llms-part-ii/)
### Guides pour la prise en compte de l'impact de l'IA
- [ARCEP & ADEME de 2023](https://www.arcep.fr/uploads/tx_gspublication/note-synthese-au-gouvernement-prospective-2030-2050_mars2023.pdf)
- [AFNOR IA frugale](https://normalisation.afnor.org/nos-solutions/afnor-spec/intelligence-artificielle-frugale/)
- [Guide de recommandation de sécurité de l'ANSSI](https://cyber.gouv.fr/publications/recommandations-de-securite-pour-un-systeme-dia-generative)
- [AI Act](https://artificialintelligenceact.eu/fr/high-level-summary/)
## II - Développement
### Plateforme de partage de modèles
- [HuggingFace](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
### Articles de recherche centraux
**Transformers**
- [Papier original **'Attention Is All You Need'**](https://arxiv.org/abs/1706.03762)
- [Explication illustrée et très détaillée](http://jalammar.github.io/illustrated-transformer/)
- [Les différents types de modèles](https://medium.com/artificial-corner/discovering-llm-structures-decoder-only-encoder-only-or-decoder-encoder-5036b0e9e88)
- [Les Mixture of Experts](https://huggingface.co/blog/moe)
**Fine-tuning**
- [LoRA](https://arxiv.org/abs/2106.09685)
- [QLoRA](https://arxiv.org/abs/2305.14314)
- [DoRA](https://arxiv.org/abs/2402.09353)
- [Introduction au RLHF](https://huggingface.co/blog/rlhf)
- [DPO](https://arxiv.org/abs/2305.18290)
- [KTO](https://arxiv.org/abs/2402.01306)
**Bonnes pratiques du prompt engineering**
- [Principled Instructions Are All You Need for Questioning LLaMA-1/2, GPT-3.5/4](https://arxiv.org/abs/2312.16171)
- [Graph of Thoughts](https://arxiv.org/pdf/2308.09687)
### Librairies et ressources
**LLM platform**
- [Ollama](https://ollama.com/)
**Pipelines et orchestration LLM**
- [LangChain](https://www.langchain.com/)
- [LlamaIndex](https://www.llamaindex.ai/)
- [Haystack](https://haystack.deepset.ai/)
**RAG**
- [Graph RAG](https://microsoft.github.io/graphrag/)
**Evaluation**
- [SelfCheckGPT](https://github.com/potsawee/selfcheckgpt)