Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Dev llama patch #46

Merged
merged 3 commits into from
Sep 18, 2023
Merged

Dev llama patch #46

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
3b94c52
changing environment variable to correct name
julius-heitkoetter Sep 18, 2023
7b01eca
added hf token reading to services
julius-heitkoetter Sep 18, 2023
1b965ba
fixing descrepency between pyproject and requirements
julius-heitkoetter Sep 18, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions A2rchi/bin/service_chat.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,7 @@

# set openai
os.environ['OPENAI_API_KEY'] = read_secret("OPENAI_API_KEY")
os.environ['HUGGING_FACE_HUB_TOKEN'] = read_secret("HUGGING_FACE_HUB_TOKEN")
config = Config_Loader().config["interfaces"]["chat_app"]
print(f"Starting Chat Service with (host, port): ({config['HOST']}, {config['PORT']})")

Expand Down
1 change: 1 addition & 0 deletions A2rchi/bin/service_cleo.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,7 @@

# set openai
os.environ['OPENAI_API_KEY'] = read_secret("OPENAI_API_KEY")
os.environ['HUGGING_FACE_HUB_TOKEN'] = read_secret("HUGGING_FACE_HUB_TOKEN")
print("Starting Cleo Service")

config = Config_Loader().config["utils"]
Expand Down
1 change: 1 addition & 0 deletions A2rchi/bin/service_data_manager.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,7 @@

# set openai
os.environ['OPENAI_API_KEY'] = read_secret("OPENAI_API_KEY")
os.environ['HUGGING_FACE_HUB_TOKEN'] = read_secret("HUGGING_FACE_HUB_TOKEN")

data_manager_config = Config_Loader().config["utils"]["data_manager"]
uploader_config = Config_Loader().config["interfaces"]["uploader_app"]
Expand Down
1 change: 1 addition & 0 deletions A2rchi/bin/service_mailbox.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,7 @@

# set openai
os.environ['OPENAI_API_KEY'] = read_secret("OPENAI_API_KEY")
os.environ['HUGGING_FACE_HUB_TOKEN'] = read_secret("HUGGING_FACE_HUB_TOKEN")
print("Starting Mailbox Service")

config = Config_Loader().config["utils"]
Expand Down
8 changes: 4 additions & 4 deletions deploy/dev-compose.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ services:
SENDER_USER_FILE: /run/secrets/sender_user
SENDER_PW_FILE: /run/secrets/sender_pw
OPENAI_API_KEY_FILE: /run/secrets/openai_api_key
HF_TOKEN_FILE: /run/secrets/hf_token
HUGGING_FACE_HUB_TOKEN_FILE: /run/secrets/hf_token
secrets:
- cleo_url
- cleo_user
Expand All @@ -45,7 +45,7 @@ services:
environment:
PROD_OR_DEV: dev
OPENAI_API_KEY_FILE: /run/secrets/openai_api_key
HF_TOKEN_FILE: /run/secrets/hf_token
HUGGING_FACE_HUB_TOKEN_FILE: /run/secrets/hf_token
secrets:
- openai_api_key
- hf_token
Expand Down Expand Up @@ -76,7 +76,7 @@ services:
SENDER_USER_FILE: /run/secrets/sender_user
SENDER_PW_FILE: /run/secrets/sender_pw
OPENAI_API_KEY_FILE: /run/secrets/openai_api_key
HF_TOKEN_FILE: /run/secrets/hf_token
HUGGING_FACE_HUB_TOKEN_FILE: /run/secrets/hf_token
secrets:
- imap_user
- imap_pw
Expand Down Expand Up @@ -105,7 +105,7 @@ services:
FLASK_UPLOADER_APP_SECRET_KEY_FILE: /run/secrets/flask_uploader_app_secret_key
UPLOADER_SALT_FILE: /run/secrets/uploader_salt
OPENAI_API_KEY_FILE: /run/secrets/openai_api_key
HF_TOKEN_FILE: /run/secrets/hf_token
HUGGING_FACE_HUB_TOKEN_FILE: /run/secrets/hf_token
secrets:
- flask_uploader_app_secret_key
- uploader_salt
Expand Down
8 changes: 4 additions & 4 deletions deploy/prod-compose.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ services:
SENDER_USER_FILE: /run/secrets/sender_user
SENDER_PW_FILE: /run/secrets/sender_pw
OPENAI_API_KEY_FILE: /run/secrets/openai_api_key
HF_TOKEN_FILE: /run/secrets/hf_token
HUGGING_FACE_HUB_TOKEN_FILE: /run/secrets/hf_token
secrets:
- cleo_url
- cleo_user
Expand All @@ -45,7 +45,7 @@ services:
environment:
PROD_OR_DEV: prod
OPENAI_API_KEY_FILE: /run/secrets/openai_api_key
HF_TOKEN_FILE: /run/secrets/hf_token
HUGGING_FACE_HUB_TOKEN_FILE: /run/secrets/hf_token
secrets:
- openai_api_key
- hf_token
Expand Down Expand Up @@ -76,7 +76,7 @@ services:
SENDER_USER_FILE: /run/secrets/sender_user
SENDER_PW_FILE: /run/secrets/sender_pw
OPENAI_API_KEY_FILE: /run/secrets/openai_api_key
HF_TOKEN_FILE: /run/secrets/hf_token
HUGGING_FACE_HUB_TOKEN_FILE: /run/secrets/hf_token
secrets:
- imap_user
- imap_pw
Expand Down Expand Up @@ -105,7 +105,7 @@ services:
FLASK_UPLOADER_APP_SECRET_KEY_FILE: /run/secrets/flask_uploader_app_secret_key
UPLOADER_SALT_FILE: /run/secrets/uploader_salt
OPENAI_API_KEY_FILE: /run/secrets/openai_api_key
HF_TOKEN_FILE: /run/secrets/hf_token
HUGGING_FACE_HUB_TOKEN_FILE: /run/secrets/hf_token
secrets:
- flask_uploader_app_secret_key
- uploader_salt
Expand Down
1 change: 1 addition & 0 deletions pyproject.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,7 @@ dependencies = [
"accelerate==0.22.0",
"backoff==2.2.1",
"beautifulsoup4==4.12.2",
"bitsandbytes==0.41.1",
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is this a needed change or was this something added to produce a commit? either way I'll approve, just curious

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

bitsandbytes is needed to quantize the model.

"chromadb==0.4.8",
"clickhouse-connect==0.6.6",
"coloredlogs==15.0.1",
Expand Down