Skip to content

Unsupervised Information Refinement Training of Large Language Models for Retrieval-Augmented Generation

Notifications You must be signed in to change notification settings

xsc1234/INFO-RAG

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Install

pip install -r requirements.text

Downloar wikipedia passage data from DPR

wget https://dl.fbaipublicfiles.com/dpr/wikipedia_split/psgs_w100.tsv.gz

Make unsupervised data

python make_unsupervised_data/make_data.py --psgs_data_path your_wikipedia_path --uns_data_path your_data_save_path

Fine-tune LLMs via LoRA follow INFO-RAG

bash train_info_rag.sh

About

Unsupervised Information Refinement Training of Large Language Models for Retrieval-Augmented Generation

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published