Skip to content

Commit

Permalink
[Fix] Typo in serve/engine.py (#3000)
Browse files Browse the repository at this point in the history
Typo engine.py
  • Loading branch information
shyeonn authored Oct 31, 2024
1 parent a00e6b5 commit b656b2d
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion python/mlc_llm/serve/engine.py
Original file line number Diff line number Diff line change
Expand Up @@ -1856,7 +1856,7 @@ def _generate( # pylint: disable=too-many-locals
generation_config: GenerationConfig,
request_id: str,
) -> Iterator[List[engine_base.CallbackStreamOutput]]:
"""Internal synchronous text generation interface of AsyncMLCEngine.
"""Internal synchronous text generation interface of MLCEngine.
The method is a coroutine that streams a list of CallbackStreamOutput
at a time via yield. The returned list length is the number of
parallel generations specified by `generation_config.n`
Expand Down

0 comments on commit b656b2d

Please sign in to comment.