Skip to content

Commit

Permalink
[CLEANUP]
Browse files Browse the repository at this point in the history
  • Loading branch information
Kye Gomez authored and Kye Gomez committed Jun 27, 2024
1 parent 59fa6d4 commit 94d7306
Show file tree
Hide file tree
Showing 2 changed files with 3 additions and 5 deletions.
4 changes: 2 additions & 2 deletions servers/cogvlm/openai_api_example.py
Original file line number Diff line number Diff line change
Expand Up @@ -3,10 +3,10 @@
# Set the API key
client = openai.OpenAI(
# clusters
# base_url="https://44.203.144.168:30001/v1", api_key="sk-1g3Z3y2c1f2z3d4b5p6w7c8b9v0n1m2"
# base_url="https://44.203.144.168:30001/v1", api_key=""
base_url="http://40.87.83.103:30001/v1",
api_key="",
# base_url="https://18.189.185.191:8000/v1", api_key="sk-1g3Z3y2c1f2z3d4b5p6w7c8b9v0n1m2"
# base_url="https://18.189.185.191:8000/v1", api_key=""
)
# Create a client object to interact with the OpenAI API
# Make a chat completion request
Expand Down
4 changes: 1 addition & 3 deletions sky_serve.yaml
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
envs:
MODEL_NAME: meta-llama/Meta-Llama-3-70B-Instruct
OPENAI_API_KEY: sk-proj-tD78rXEnJ49FYAztSLmyT3BlbkFJ9DM5hxZ92ot7tlgvFlHY


OPENAI_API_KEY:
# Service configuration
service:
readiness_probe:
Expand Down

0 comments on commit 94d7306

Please sign in to comment.