You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
getsentry/taskbroker is using split_partition_queue, and that allows them to poll the consumer separately from pulling messages out of it.
Right now we pause the consumer on backpressure to not receive messages. If we used split_partition_queue, that would be obsolete and handling backpressure in arroyo would become simpler.
It seems however that this is not an option for python, as confluent-kafka doesn't have split_partition_queue. Might be a Rust-only thing.
The text was updated successfully, but these errors were encountered:
getsentry/taskbroker is using split_partition_queue, and that allows them to poll the consumer separately from pulling messages out of it.
Right now we pause the consumer on backpressure to not receive messages. If we used split_partition_queue, that would be obsolete and handling backpressure in arroyo would become simpler.
It seems however that this is not an option for python, as confluent-kafka doesn't have split_partition_queue. Might be a Rust-only thing.
The text was updated successfully, but these errors were encountered: