Skip to content

Commit 23c277c

Browse files
committed
Add --ctx param to Prepare Data & Run section
1 parent 840ff4c commit 23c277c

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

README.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -514,7 +514,8 @@ ls ./models
514514
python3 -m pip install -r requirements.txt
515515
516516
# convert the 7B model to ggml FP16 format
517-
python3 convert.py models/7B/
517+
# Use --ctx 4096 for LLaMA v2
518+
python3 convert.py models/7B/ --ctx 2048
518519
519520
# [Optional] for models using BPE tokenizers
520521
python convert.py models/7B/ --vocabtype bpe

0 commit comments

Comments
 (0)