fix-2024-03-07_22:43:08

kklen · Mar 7, 2024 · 6fe829a · 6fe829a
1 parent 846a57b
commit 6fe829a
Show file tree

Hide file tree

Showing 4 changed files with 32 additions and 17 deletions.
diff --git a/faq/FAQ.md b/faq/FAQ.md
@@ -0,0 +1,29 @@
+
+
+## FAQ
+
+
+### baichuan2报错
+
+- 'BitsAndBytesConfig' object is not subscriptable
+
+https://huggingface.co/baichuan-inc/Baichuan2-7B-Chat/discussions/2
+
+
+
+- AttributeError: 'BaichuanTokenizer' object has no attribute 'sp_model'
+
+降低版本到4.34.0及以下 ： pip install transformers==4.34.0
+
+
+
+## Pytorch
+
+- RuntimeError: DataLoader worker (pid xxxxx) is killed by signal: Killed.
+
+可能共享内存太小了
+
+--shm-size 4G 
+
+
+
diff --git a/docs/llm-eval/README.md → llm-eval/README.md b/docs/llm-eval/README.md → llm-eval/README.md
@@ -17,8 +17,11 @@ PPL越小越好，PPL越小，p(wi)则越大，也就是说这句话中每个词
 
 
 
+### Rouge
 
 
+https://github.com/Isaac-JL-Chen/rouge_chinese
+
 
 
 

diff --git a/docs/llm-eval/大模型测评集.md → llm-eval/大模型测评集.md b/docs/llm-eval/大模型测评集.md → llm-eval/大模型测评集.md
diff --git a/llmops/tq-llm/train/README.md b/llmops/tq-llm/train/README.md
@@ -36,23 +36,6 @@ seq_length
 
 
 
-## FAQ
-
-
-### baichuan2报错
-
-- 'BitsAndBytesConfig' object is not subscriptable
-
-https://huggingface.co/baichuan-inc/Baichuan2-7B-Chat/discussions/2
-
-
-
-- AttributeError: 'BaichuanTokenizer' object has no attribute 'sp_model'
-
-降低版本到4.34.0及以下 ： pip install transformers==4.34.0
-
-
-
Original file line number	Diff line number	Diff line change
Expand Up		@@ -17,8 +17,11 @@ PPL越小越好，PPL越小，p(wi)则越大，也就是说这句话中每个词



		### Rouge


		https://github.com/Isaac-JL-Chen/rouge_chinese




Expand Down