You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Because it will always fail with a CONNECTION REFUSED since we have no such monitor daemon:
2024-09-19 21:31:47 | INFO | gradio_web_server | bot_response. ip: 127.0.0.1
2024-09-19 21:31:47 | INFO | gradio_web_server | monitor error: HTTPConnectionPool(host='localhost', port=9090): Max retries exceeded with url: /is_limit_reached?model=Llama%20405%20on%20WestAI&user_id=127.0.0.1 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x119061610>: Failed to establish a new connection: [Errno 61] Connection refused'))
The text was updated successfully, but these errors were encountered:
In gradio_web_server.py, there is a hardcoded host and port for a supposed monitor daemon, but no daemon is around:
FastChat/fastchat/serve/gradio_web_server.py
Line 391 in a04072e
This, in turn, breaks the usage of openAI endpoints with the --register to a json file.
So, for example, this openai_compatible_server.json can't run:
Because it will always fail with a
CONNECTION REFUSED
since we have no such monitor daemon:The text was updated successfully, but these errors were encountered: