Kubernetes deployment issue:

[Prakhar-Goyal-git]

What happened?

I tried deploying the docker image of chroma db to gcp kubernetes and mounting persistant volume claim to it but after starting it the logs showed this error.
exec /usr/local/bin/uvicorn: exec format error

Can you please help me

Versions

chroma 0.4.15 release github.com/chroma-core/chroma

Relevant log output

exec /usr/local/bin/uvicorn: exec format error

[tazarov]

@Prakhar-Goyal-git, the error you are seeing usually means system incompatibility. Can you tell me about your worker nodes, and what arch and OS are they running?

[Prakhar-Goyal-git]

@tazarov I tried using the image ghcr.io/chroma-core/chroma:0.4.18.dev2@sha256:1bab0b7f114f6e0be42f945da0459b2c8aaa65d5479d9b1661afa8d6b9f73b82 which is a linux/amd64 image and it is not giving exe format error but have this error:
ERROR: could not install packages due to an OSError: [Errno 13] Permission denied: '/.local'
check permission

Error: Invalid value for --log-config: Path chroma/log_config.yml does not exists

Now the linux image i create in local is giving the same error as format one but using the official image available is giving permission erro =r how to resolve this one.

[tazarov]

@Prakhar-Goyal-git, thanks for your patience on this.

You need to specify the command you want to run in the k8s manifest:

....
      command: ["sh", "-c", "uvicorn chromadb.app:app --workers 1 --host 0.0.0.0 --port 8000 --proxy-headers --log-config chromadb/log_config.yml"]
...

[Prakhar-Goyal-git]

@tazarov
Hi on using this command i am getting this error

Traceback (most recent call last):
File "/usr/local/bin/uvicorn", line 8, in <module>
sys.exit(main())
File w/usr/ ocal/hibeython3:1a/ste-packages/cltd/core.py`, line 1157, in _calL
return self main(*args, #*kwargs)
File "/usrhocal/hih/python3.10/site-packages/cltck/core.py", line 1078, in main
rv- self.invoke(ctx)
File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/usr/local/lib/python3.10/site-packages/click/core.py", line 783, in invoke
return -_callback(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/uvicorn/main.py", line 408, in main
runC
File "/usr/local/lib/python3.10/site-packages/uvicorn/main.py", line 576, in run
server,runO)
File "/usr/local/lib/python3.10/site-packages/uvicorn/server.py", line 60, in run
return asyncio.run(self.serve(sockets=sockets))
File "/usr/local/lib/python3.10/asyncio/runners.py", line 44, in run
return loop.run_until_completeCmain)
File "uvloop/loop.pyx", line 1517, in uvloop.loop.Loop.run_until_complete
File "/usr/local/lib/python3.10/site-packages/uvicorn/server.py", line 67, in serve
config.loadQ)
File. "/usr/local/lib/python3.10/site-packages/uvicorn/config.py", line 479, in load
self.loaded_app = import_from_string(self.app)
File "/usr/local/lib/python3.10/site-packages/uvicorn/importer.py", line 24, in import_from_string
raise exc from None
File "/usr/local/lib/python3.10/site-packages/uvicorn/importer.py", line 21, in import_fromstring
module = importlib.import_module(module_str)
File "/usr/local/lib/python3.10/importlib/_init_.py", line 126, in import_module
return -bootstrap.-gcd_import(name[level:], package, level)
File "<frozen importlib._bootstrap>", line 1050, in -gcd_import
File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
File "<frozen importlib._bootstrap>", line 992, in find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
File "<frozen importlib._bootstrap>", line 1050, in gcd_import
File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
File "<frozen importlib._bootstrap>", line 1004, in _find_and_load_unlocked
ModuleNotFoundError: No module named .'chromadb'

I am not sure why is this happening

[tazarov]

@Prakhar-Goyal-git, let me send you a full deployment manifest example

[SHIHAO-FD]

Hi @tazarov , Can you please share the full deployment manifest example? We are encountering the similar issue here. Thank you!

[sfc-gh-ygupta]

@tazarov is there any documentation available to deploy the Chromadb on EKS cluster?
Or could you please provide me deployment file?

[sfc-gh-ygupta]

@tazarov is there any documentation available to deploy the Chromadb on EKS cluster? Or could you please provide me deployment file?

@tazarov , Please help here.

[tazarov]

@sfc-gh-ygupta, I have added your question as an issue in the amikos-tech/chromadb-chart#40. If time permits I'll add the steps in the next day or two.

[tazarov]

@Prakhar-Goyal-git, thanks for the patience. You can create your manifests like this:

helm repo add chroma https://amikos-tech.github.io/chromadb-chart/
helm repo update
helm template chroma chroma/chromadb -f values.yaml > deployment.yaml

Make sure to update your values.yaml as per the config options available here - https://github.com/amikos-tech/chromadb-chart#chart-configuration-values

[itaismith]

Closing due to inactivity for some time. @Prakhar-Goyal-git if the above still doesn't work for you, feel free to open a new issue!