New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

sglang_work not working on sglang v0.2.13 #3498

Open

exceedzhang opened this issue Aug 27, 2024 · 0 comments

exceedzhang commented Aug 27, 2024

Error in sys.excepthook: ubuntu-xllm-stream-1-1 | Original exception was: ubuntu-xllm-stream-1-1 | 2024-08-27 12:54:55 | ERROR | stderr | Traceback (most recent call last): ubuntu-xllm-stream-1-1 | 2024-08-27 12:54:55 | ERROR | stderr | File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main ubuntu-xllm-stream-1-1 | 2024-08-27 12:54:55 | ERROR | stderr | return _run_code(code, main_globals, None, ubuntu-xllm-stream-1-1 | 2024-08-27 12:54:55 | ERROR | stderr | File "/usr/lib/python3.10/runpy.py", line 86, in _run_code ubuntu-xllm-stream-1-1 | 2024-08-27 12:54:55 | ERROR | stderr | exec(code, run_globals) ubuntu-xllm-stream-1-1 | 2024-08-27 12:54:55 | ERROR | stderr | File "/usr/local/lib/python3.10/dist-packages/fastchat/serve/sglang_worker.py", line 290, in ubuntu-xllm-stream-1-1 | 2024-08-27 12:54:55 | ERROR | stderr | runtime = sgl.Runtime( ubuntu-xllm-stream-1-1 | 2024-08-27 12:54:55 | ERROR | stderr | File "/usr/local/lib/python3.10/dist-packages/sglang/api.py", line 40, in Runtime ubuntu-xllm-stream-1-1 | 2024-08-27 12:54:55 | ERROR | stderr | return Runtime(*args, **kwargs) ubuntu-xllm-stream-1-1 | 2024-08-27 12:54:55 | ERROR | stderr | File "/usr/local/lib/python3.10/dist-packages/sglang/srt/server.py", line 534, in __init__ ubuntu-xllm-stream-1-1 | 2024-08-27 12:54:55 | ERROR | stderr | raise RuntimeError( ubuntu-xllm-stream-1-1 | 2024-08-27 12:54:55 | ERROR | stderr | RuntimeError: Initialization failed. Please see the error messages above. @merrymercy

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment