create virtual env
$ python -m venv venv
$ source venv/bin/activate
$ pip install -r requirements.txt
- Create Data for pretraining
$ python src-llm/run.py -c data_prep
- Pretraining a foundation model
$ python src-llm/run.py -c pretrain_and_save
- if you want to just run the code and donot wish to save the model run the following cmd
$ python src-llm/run.py -c pretrain
To run chainlit db integration use server.py in src folder