Skip to content

Commit

Permalink
(docs) Add section to user guide regarding load balancing. (#564)
Browse files Browse the repository at this point in the history
  • Loading branch information
monorimet authored Nov 18, 2024
1 parent 4770759 commit ff7771c
Showing 1 changed file with 4 additions and 0 deletions.
4 changes: 4 additions & 0 deletions docs/user_guide.md
Original file line number Diff line number Diff line change
Expand Up @@ -77,6 +77,10 @@ python -m shortfin_apps.sd.simple_client --interactive

Congratulations!!! At this point you can play around with the server and client based on your usage.

### Note: Server implementation scope

The SDXL server's implementation does not account for extremely large client batches. Normally, for heavy workloads, services would be composed under a load balancer to ensure each service is fed with requests optimally. For most cases outside of large-scale deployments, the server's internal batching/load balancing is sufficient.

### Update flags

Please see --help for both the server and client for usage instructions. Here's a quick snapshot.
Expand Down

0 comments on commit ff7771c

Please sign in to comment.