Skip to content

Commit df90de9

Browse files
authored
[performance](load) increase max_broker_concurrency to 100 (#44929)
Increase default `max_broker_concurrency` to 100 to improve broker load performance. This option will affect the max number of scan / sink instances allowed in a broker load. ``` parallel instance = min(max_broker_concurrency, source file size / min_bytes_per_broker_scanner, num backends * load_parallelism) ``` S3 load time of tpcds_1000g catalog_sales: * before: 438s * after: 225s
1 parent 8ad6b28 commit df90de9

File tree

1 file changed

+1
-1
lines changed
  • fe/fe-common/src/main/java/org/apache/doris/common

1 file changed

+1
-1
lines changed

fe/fe-common/src/main/java/org/apache/doris/common/Config.java

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -784,7 +784,7 @@ public class Config extends ConfigBase {
784784

785785
@ConfField(mutable = true, masterOnly = true, description = {
786786
"单个 broker scanner 的最大并发数。", "Maximal concurrency of broker scanners."})
787-
public static int max_broker_concurrency = 10;
787+
public static int max_broker_concurrency = 100;
788788

789789
// TODO(cmy): Disable by default because current checksum logic has some bugs.
790790
@ConfField(mutable = true, masterOnly = true, description = {

0 commit comments

Comments
 (0)