New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

503 when hosting on huggingface #7

Open

jayendra-ram opened this issue Jan 22, 2025 · 1 comment

jayendra-ram commented Jan 22, 2025

Hello,

Hosting this model on huggingface leads in a lot of 503s when sending it large screenshots.

[2025-01-22 14:04:14,106 INFO agent/822-MainProcess] Generating content with BD model: bd
[2025-01-22 14:04:19,082 ERROR agent/841-MainProcess] Error calling BD model: Error code: 503 - {'error': '503 Service Unavailable'}
[2025-01-22 14:04:19,082 INFO agent/545-MainProcess] RESPONSE: 
[2025-01-22 14:04:19,083 INFO agent/555-MainProcess] ACTIONS: []

This is running it on OSWorld.

If anyone is able to host and runt his model succesfully please let me know.

The text was updated successfully, but these errors were encountered:

Collaborator

AHEADer commented Jan 22, 2025

according to this deployment doc: https://juniper-switch-f10.notion.site/GUI-Model-Deployment-Guide-17b5350241e280058e98cea60317de71 , you have two ways:

increase the payload limit by changing the env variable when you launch the model via inference endpoint
resize your image before sending the requests, the doc provide a way to resize your image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment