Skip to content

Commit

Permalink
[Doc] Fix figure in README
Browse files Browse the repository at this point in the history
  • Loading branch information
SiriusNEO committed Jun 3, 2024
1 parent 56c1dfd commit f757f85
Show file tree
Hide file tree
Showing 3 changed files with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
Parrot is a distributed serving system for LLM-based Applications. The Parrot API w/ Semantic Variable is served by a centralized cluster manager called `ServeCore`, which manages many `Engine` instances. Each Parrot `Engine` runs a single LLM model and communicates with `ServeCore` by contextual Fill/Gen APIs. Note that each `Engine` is capable of providing language model services independently, therefore the system is horizontally scalable and many types of `Engine`s can be integrated into Parrot (e.g., vLLM, FasterTransformer, etc.).

![](assets/systemarch.pdf)
![](assets/arch_paper_ver.png)

## Install

Expand Down
Binary file added assets/arch_paper_ver.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
File renamed without changes

0 comments on commit f757f85

Please sign in to comment.