You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am looking for an async compatible rerank client for AWS Bedrock. Currently I see that BedrockClientV2 inherits from AwsClientV2 -> ClientV2. Is there something similar planned to make an AsyncBedrockClient from AsyncClientV2? It seems to me this is quite achievable as it would mean just using the same event hooks I think? Or am I missing something more complicated. Thanks.
The text was updated successfully, but these errors were encountered:
Hey @lucasgadams thanks so much for the suggestion. I have looked into this, and unfortunately the AWS libraries do not provide async implementations. There is some complexity to implementing their http logic so we don't plan producing our own async aws clients.
Are you able to use something like run_in_executor for your use case?
Describe the improvement
I am looking for an async compatible rerank client for AWS Bedrock. Currently I see that BedrockClientV2 inherits from AwsClientV2 -> ClientV2. Is there something similar planned to make an AsyncBedrockClient from AsyncClientV2? It seems to me this is quite achievable as it would mean just using the same event hooks I think? Or am I missing something more complicated. Thanks.
The text was updated successfully, but these errors were encountered: