Skip to content

Commit

Permalink
Fix a typo in example
Browse files Browse the repository at this point in the history
  • Loading branch information
qli88 committed Oct 25, 2024
1 parent 99bb48d commit 68b9476
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion examples/offline_inference.py
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@
sampling_params = SamplingParams(temperature=0.8, top_p=0.95)

# Create an LLM.
llm = LLM(model="/models/opt-125m")
llm = LLM(model="facebook/opt-125m")
# Generate texts from the prompts. The output is a list of RequestOutput objects
# that contain the prompt, generated text, and other information.
outputs = llm.generate(prompts, sampling_params)
Expand Down

0 comments on commit 68b9476

Please sign in to comment.