Skip to content

Network error when running inference? #1449

Closed Answered by junxiant
junxiant asked this question in Q&A
Discussion options

You must be logged in to vote

I have tested it out on the API and it seems like I am getting a 504 gateway timeout,

After checking out the load balancer it seems like aws was the issue. Changing the "Idle timeout" settings from 60 to 180 seems to have solved the issue. Looks like the load balancer was closing the connection to the server when the inference was running for more than 60 secs.

Replies: 3 comments

Comment options

You must be logged in to vote
0 replies
Comment options

You must be logged in to vote
0 replies
Comment options

You must be logged in to vote
0 replies
Answer selected by junxiant
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants