Skip to content

Commit f43de89

Browse files
Update README.md
1 parent 4710e3d commit f43de89

File tree

1 file changed

+4
-4
lines changed

1 file changed

+4
-4
lines changed

README.md

+4-4
Original file line numberDiff line numberDiff line change
@@ -128,7 +128,7 @@ There are three main ways to use PromptWizard:
128128
- Both the train and test set follow the same format
129129
- Every sample in the ```.jsonl``` should have 2 fields :
130130
1) ```question``` : It should contain the complete question that is to asked to the LLM
131-
2) ```answer``` : It should contain the ground truth answer which can be verbose or consize
131+
2) ```answer``` : It should contain the ground truth answer which can be verbose or concise
132132
133133
134134
### Run on Custom Dataset
@@ -177,10 +177,10 @@ NOTE : Refer to [demos](demos) folder for examples of folders for four datasets.
177177
- ```generate_synthetic_examples``` is a global hyperparameter which can be used when there are no training samples and we want to generate synthetic data for training
178178
- ```use_examples``` is a global hyperparameter which can be used to optimize prompts using training data
179179
3) Create a dataset specific class which inherits ```class DatasetSpecificProcessing``` similar to ```GSM8k(DatasetSpecificProcessing)``` in [demo.ipynb](demos/gsm8k/demo.ipynb) and define the following functions in it
180-
1) In ```def extract_answer_from_output()``` : This is a dataset specific function, given the ```answer``` from the dataset it should extract and return a consize form of the answer. Note that based on the dataset it can also simply return the ```answer``` as it is like in case of SVAMP and AQUARAT datasets
181-
2) ```def extract_final_answer()``` : This is a LLM output specific function, given the verbose answer from the LLM it should extract and return the consize final answer
180+
1) In ```def extract_answer_from_output()``` : This is a dataset specific function, given the ```answer``` from the dataset it should extract and return a concise form of the answer. Note that based on the dataset it can also simply return the ```answer``` as it is like in case of SVAMP and AQUARAT datasets
181+
2) ```def extract_final_answer()``` : This is a LLM output specific function, given the verbose answer from the LLM it should extract and return the concise final answer
182182
3) Define ```def access_answer()``` : This function takes an input the LLM output, then does the following:
183-
- Extracts the consize answer using ```def extract_final_answer()``` from the LLM output as defined above
183+
- Extracts the concise answer using ```def extract_final_answer()``` from the LLM output as defined above
184184
- Evaluates the extracted answer with the ground truth and retuns
185185
- Extracted answer from LLM output
186186
- Boolean value indicating if answer is correct or not

0 commit comments

Comments
 (0)