Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix][nereids] fix split count distinct for null can't join #46563

Merged
merged 4 commits into from
Jan 10, 2025

Conversation

qzsee
Copy link
Contributor

@qzsee qzsee commented Jan 7, 2025

What problem does this PR solve?

related pr: #45209

If split cout distinct and group by are used, inner join will be used to link the results, but if the group by column has a null value, inner join will not be linked, so we use NullSafeEqual as the link condition

detail sedd regression test cases

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dqz123
Copy link

dqz123 commented Jan 7, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32579 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ed41588a58d2616d8065a4869b481ca8472bd3c1, data reload: false

------ Round 1 ----------------------------------
q1	17613	6714	6068	6068
q2	2042	293	166	166
q3	10429	1225	708	708
q4	10226	861	431	431
q5	7492	2168	1932	1932
q6	208	179	144	144
q7	903	764	619	619
q8	9224	1300	1158	1158
q9	5209	4866	4934	4866
q10	6728	2299	1839	1839
q11	475	278	264	264
q12	355	361	218	218
q13	17760	3626	3041	3041
q14	230	237	217	217
q15	560	496	499	496
q16	640	633	597	597
q17	580	840	346	346
q18	7107	6520	6426	6426
q19	1219	951	527	527
q20	327	320	189	189
q21	2844	2238	2020	2020
q22	365	331	307	307
Total cold run time: 102536 ms
Total hot run time: 32579 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6260	6243	6238	6238
q2	231	326	232	232
q3	2252	2613	2319	2319
q4	1432	1821	1333	1333
q5	4360	4767	4779	4767
q6	184	183	143	143
q7	2071	1939	1838	1838
q8	2607	2810	2655	2655
q9	7337	7093	7231	7093
q10	3031	3303	2790	2790
q11	575	526	495	495
q12	660	752	607	607
q13	3522	3864	3180	3180
q14	292	302	290	290
q15	571	500	513	500
q16	663	701	664	664
q17	1208	1712	1234	1234
q18	7745	7480	7159	7159
q19	795	969	1091	969
q20	1907	1942	1824	1824
q21	5335	5093	4838	4838
q22	596	645	569	569
Total cold run time: 53634 ms
Total hot run time: 51737 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 189590 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ed41588a58d2616d8065a4869b481ca8472bd3c1, data reload: false

query1	972	371	370	370
query2	6521	2430	2333	2333
query3	6716	211	216	211
query4	33394	23558	23267	23267
query5	4398	634	445	445
query6	273	216	192	192
query7	4618	509	299	299
query8	324	259	241	241
query9	9619	2786	2762	2762
query10	465	320	254	254
query11	18133	15349	15155	15155
query12	161	108	105	105
query13	1668	541	414	414
query14	10008	6943	6753	6753
query15	248	189	183	183
query16	8429	590	429	429
query17	1580	755	594	594
query18	2173	405	301	301
query19	218	184	151	151
query20	118	113	110	110
query21	214	134	146	134
query22	4380	4442	4100	4100
query23	35820	33618	33370	33370
query24	6783	2271	2325	2271
query25	446	440	380	380
query26	1069	250	153	153
query27	2495	455	336	336
query28	5412	2493	2441	2441
query29	549	500	416	416
query30	247	182	155	155
query31	976	912	842	842
query32	100	58	61	58
query33	495	343	292	292
query34	758	844	516	516
query35	822	828	735	735
query36	985	1084	953	953
query37	122	101	74	74
query38	4020	4161	4215	4161
query39	1519	1427	1441	1427
query40	203	120	105	105
query41	46	47	46	46
query42	124	102	99	99
query43	515	538	486	486
query44	1292	804	803	803
query45	185	170	168	168
query46	864	1041	645	645
query47	1906	1931	1863	1863
query48	380	415	328	328
query49	782	484	382	382
query50	647	652	412	412
query51	6956	6848	6780	6780
query52	103	105	94	94
query53	234	261	184	184
query54	472	484	402	402
query55	77	76	79	76
query56	259	273	239	239
query57	1186	1192	1114	1114
query58	240	234	239	234
query59	3079	3044	2892	2892
query60	275	265	249	249
query61	126	117	111	111
query62	868	790	720	720
query63	234	191	199	191
query64	4668	1018	682	682
query65	3287	3176	3229	3176
query66	1065	444	316	316
query67	15953	15855	15549	15549
query68	8207	698	500	500
query69	471	282	263	263
query70	1199	1140	1135	1135
query71	490	289	258	258
query72	6099	3861	3806	3806
query73	660	750	364	364
query74	10693	9175	9111	9111
query75	3938	3172	2662	2662
query76	3727	1198	760	760
query77	772	351	275	275
query78	10110	10348	9426	9426
query79	2734	794	605	605
query80	639	546	507	507
query81	467	272	239	239
query82	612	159	120	120
query83	162	180	148	148
query84	233	93	74	74
query85	775	346	310	310
query86	348	315	304	304
query87	4584	4465	4275	4275
query88	4373	2263	2222	2222
query89	413	409	292	292
query90	1934	188	200	188
query91	139	140	112	112
query92	69	57	52	52
query93	1275	876	538	538
query94	664	387	279	279
query95	327	261	252	252
query96	490	609	283	283
query97	2916	3011	2857	2857
query98	219	199	195	195
query99	1628	1565	1449	1449
Total cold run time: 294641 ms
Total hot run time: 189590 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.65 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ed41588a58d2616d8065a4869b481ca8472bd3c1, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.03
query3	0.24	0.07	0.07
query4	1.61	0.11	0.10
query5	0.42	0.42	0.39
query6	1.17	0.65	0.65
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.57	0.50	0.50
query10	0.56	0.56	0.55
query11	0.15	0.11	0.10
query12	0.13	0.11	0.11
query13	0.61	0.61	0.58
query14	2.81	2.76	2.84
query15	0.89	0.82	0.82
query16	0.37	0.38	0.38
query17	1.05	1.03	0.96
query18	0.23	0.21	0.21
query19	1.98	1.81	2.05
query20	0.01	0.01	0.01
query21	15.37	0.94	0.59
query22	0.76	0.80	0.68
query23	15.24	1.37	0.62
query24	2.94	1.71	1.46
query25	0.18	0.20	0.07
query26	0.24	0.14	0.13
query27	0.07	0.05	0.04
query28	14.22	1.49	1.05
query29	12.64	3.98	3.26
query30	0.24	0.08	0.06
query31	2.83	0.60	0.38
query32	3.24	0.54	0.46
query33	3.08	3.16	3.09
query34	16.79	5.07	4.45
query35	4.45	4.45	4.44
query36	0.66	0.49	0.48
query37	0.10	0.06	0.05
query38	0.05	0.04	0.04
query39	0.04	0.02	0.03
query40	0.17	0.13	0.12
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.02
Total cold run time: 106.43 s
Total hot run time: 31.65 s

morrySnow
morrySnow previously approved these changes Jan 7, 2025
@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jan 7, 2025
Copy link
Contributor

github-actions bot commented Jan 7, 2025

PR approved by at least one committer and no changes requested.

Copy link
Contributor

github-actions bot commented Jan 7, 2025

PR approved by anyone and no changes requested.

@dqz123
Copy link

dqz123 commented Jan 8, 2025

run p0

1 similar comment
@dqz123
Copy link

dqz123 commented Jan 8, 2025

run p0

@dqz123
Copy link

dqz123 commented Jan 8, 2025

run buildall

@dqz123
Copy link

dqz123 commented Jan 8, 2025

run p0

@doris-robot
Copy link

TPC-H: Total hot run time: 32821 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2af0a05f672ce669ffe9eb5cb11b356640a789ca, data reload: false

------ Round 1 ----------------------------------
q1	17626	6084	6045	6045
q2	2052	292	172	172
q3	10440	1224	739	739
q4	10207	865	446	446
q5	7793	2180	1961	1961
q6	208	178	147	147
q7	885	751	602	602
q8	9232	1366	1161	1161
q9	5257	4924	4914	4914
q10	6772	2297	1849	1849
q11	480	285	259	259
q12	351	372	228	228
q13	18162	3823	3223	3223
q14	231	247	225	225
q15	566	503	492	492
q16	634	620	603	603
q17	611	867	332	332
q18	7144	6480	6363	6363
q19	2109	956	553	553
q20	312	310	187	187
q21	2830	2241	2010	2010
q22	361	327	310	310
Total cold run time: 104263 ms
Total hot run time: 32821 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6304	6219	6199	6199
q2	242	320	227	227
q3	2243	2661	2333	2333
q4	1391	1833	1361	1361
q5	4325	4772	4880	4772
q6	194	179	144	144
q7	2087	1951	1821	1821
q8	2675	2808	2679	2679
q9	7313	7203	7284	7203
q10	3078	3366	2763	2763
q11	566	518	499	499
q12	658	764	671	671
q13	3532	3836	3268	3268
q14	295	296	280	280
q15	568	507	505	505
q16	659	707	642	642
q17	1219	1717	1279	1279
q18	7676	7540	7354	7354
q19	859	1176	1100	1100
q20	1992	2052	1918	1918
q21	5643	5196	4985	4985
q22	647	624	597	597
Total cold run time: 54166 ms
Total hot run time: 52600 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197363 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2af0a05f672ce669ffe9eb5cb11b356640a789ca, data reload: false

query1	1322	955	910	910
query2	6442	2294	2316	2294
query3	11108	4681	4779	4681
query4	33190	23777	23561	23561
query5	4368	647	488	488
query6	284	214	192	192
query7	3993	492	313	313
query8	310	260	236	236
query9	9463	2818	2796	2796
query10	480	322	271	271
query11	18536	15405	15242	15242
query12	177	107	109	107
query13	1775	546	423	423
query14	11263	7676	8447	7676
query15	235	207	216	207
query16	7340	621	487	487
query17	1583	759	562	562
query18	1948	390	314	314
query19	199	178	158	158
query20	144	118	117	117
query21	206	124	111	111
query22	4606	4487	4515	4487
query23	33891	33471	33546	33471
query24	5998	2290	2368	2290
query25	510	484	387	387
query26	722	278	171	171
query27	2004	477	340	340
query28	5598	2513	2516	2513
query29	555	555	431	431
query30	214	195	155	155
query31	977	939	818	818
query32	78	62	57	57
query33	480	359	305	305
query34	785	853	514	514
query35	815	879	748	748
query36	1042	1010	981	981
query37	124	100	81	81
query38	4107	4500	4290	4290
query39	1520	1473	1480	1473
query40	200	113	103	103
query41	44	48	47	47
query42	123	108	113	108
query43	519	542	498	498
query44	1354	860	835	835
query45	192	175	165	165
query46	892	1059	666	666
query47	1974	1998	1934	1934
query48	397	438	328	328
query49	703	480	384	384
query50	671	647	400	400
query51	7153	7091	7076	7076
query52	102	103	89	89
query53	225	252	191	191
query54	475	489	409	409
query55	87	80	79	79
query56	266	281	275	275
query57	1244	1227	1174	1174
query58	231	241	221	221
query59	3130	3230	3041	3041
query60	276	269	268	268
query61	116	107	110	107
query62	888	820	754	754
query63	230	196	189	189
query64	3041	1043	675	675
query65	3352	3249	3263	3249
query66	785	411	310	310
query67	16556	15741	15456	15456
query68	9655	725	538	538
query69	475	311	255	255
query70	1225	1157	1037	1037
query71	429	282	245	245
query72	6256	3841	3784	3784
query73	669	764	366	366
query74	10038	9309	8829	8829
query75	4639	3158	2631	2631
query76	4663	1198	788	788
query77	905	381	285	285
query78	10098	10135	9564	9564
query79	3920	808	579	579
query80	738	523	438	438
query81	491	272	234	234
query82	446	154	128	128
query83	195	159	147	147
query84	274	85	71	71
query85	824	362	295	295
query86	357	320	301	301
query87	4453	4724	4418	4418
query88	3517	2276	2248	2248
query89	454	337	292	292
query90	2140	189	189	189
query91	208	132	110	110
query92	64	56	53	53
query93	2316	853	536	536
query94	667	392	300	300
query95	332	270	251	251
query96	502	622	284	284
query97	2973	2982	2844	2844
query98	227	215	198	198
query99	1667	1514	1436	1436
Total cold run time: 299435 ms
Total hot run time: 197363 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.69 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2af0a05f672ce669ffe9eb5cb11b356640a789ca, data reload: false

query1	0.04	0.05	0.03
query2	0.07	0.04	0.03
query3	0.24	0.07	0.06
query4	1.61	0.11	0.11
query5	0.42	0.42	0.43
query6	1.15	0.66	0.65
query7	0.02	0.01	0.02
query8	0.04	0.02	0.04
query9	0.58	0.51	0.49
query10	0.56	0.57	0.56
query11	0.14	0.10	0.10
query12	0.14	0.10	0.10
query13	0.61	0.60	0.60
query14	2.84	2.86	2.76
query15	0.88	0.83	0.81
query16	0.38	0.36	0.40
query17	1.06	1.06	1.03
query18	0.22	0.21	0.21
query19	1.93	1.87	1.99
query20	0.02	0.01	0.02
query21	15.37	0.95	0.58
query22	0.75	0.86	0.66
query23	15.25	1.39	0.56
query24	3.48	1.30	1.74
query25	0.28	0.06	0.07
query26	0.18	0.14	0.13
query27	0.06	0.06	0.06
query28	14.79	1.42	1.04
query29	12.60	3.96	3.29
query30	0.24	0.08	0.06
query31	2.84	0.59	0.38
query32	3.23	0.54	0.47
query33	3.09	3.11	3.08
query34	16.83	5.10	4.53
query35	4.54	4.47	4.55
query36	0.66	0.49	0.48
query37	0.09	0.07	0.06
query38	0.04	0.04	0.03
query39	0.03	0.03	0.02
query40	0.16	0.13	0.13
query41	0.08	0.02	0.02
query42	0.03	0.03	0.02
query43	0.03	0.03	0.03
Total cold run time: 107.6 s
Total hot run time: 31.69 s

@dqz123
Copy link

dqz123 commented Jan 8, 2025

run p0

1 similar comment
@dqz123
Copy link

dqz123 commented Jan 8, 2025

run p0

@dqz123
Copy link

dqz123 commented Jan 8, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32872 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 53389d73e2954eb7a2b39f2043627e216d7c08d5, data reload: false

------ Round 1 ----------------------------------
q1	17573	6260	6098	6098
q2	2046	318	171	171
q3	10509	1300	714	714
q4	10260	881	425	425
q5	8839	2205	2003	2003
q6	217	183	147	147
q7	909	753	622	622
q8	9233	1396	1198	1198
q9	5280	4935	4964	4935
q10	6732	2317	1847	1847
q11	498	274	254	254
q12	353	364	219	219
q13	17764	3703	3112	3112
q14	236	237	211	211
q15	577	509	490	490
q16	626	608	575	575
q17	573	867	329	329
q18	7100	6518	6458	6458
q19	1987	1010	590	590
q20	302	317	187	187
q21	2840	2126	1970	1970
q22	373	338	317	317
Total cold run time: 104827 ms
Total hot run time: 32872 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6388	6269	6312	6269
q2	240	326	229	229
q3	2191	2665	2321	2321
q4	1392	1835	1377	1377
q5	4326	4735	4950	4735
q6	189	183	142	142
q7	2090	1923	1799	1799
q8	2664	2867	2715	2715
q9	7232	7202	7132	7132
q10	3041	3315	2794	2794
q11	587	525	495	495
q12	659	741	612	612
q13	3465	3834	3256	3256
q14	290	309	313	309
q15	562	525	493	493
q16	659	671	657	657
q17	1214	1778	1281	1281
q18	7854	7558	7274	7274
q19	825	1170	1131	1131
q20	1973	2043	1948	1948
q21	5620	5297	4928	4928
q22	618	584	570	570
Total cold run time: 54079 ms
Total hot run time: 52467 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 187911 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 53389d73e2954eb7a2b39f2043627e216d7c08d5, data reload: false

query1	975	385	365	365
query2	6528	2482	2278	2278
query3	6703	221	218	218
query4	33525	23445	23157	23157
query5	4404	603	454	454
query6	286	203	186	186
query7	4620	505	300	300
query8	321	250	252	250
query9	9612	2760	2753	2753
query10	444	307	246	246
query11	18070	15138	15374	15138
query12	159	116	105	105
query13	1676	535	402	402
query14	10080	7102	7408	7102
query15	261	186	182	182
query16	8901	594	437	437
query17	1649	747	575	575
query18	2154	430	287	287
query19	201	181	146	146
query20	122	108	114	108
query21	208	121	101	101
query22	4290	4334	4347	4334
query23	33590	32751	32839	32751
query24	6400	2247	2195	2195
query25	502	444	371	371
query26	1193	262	149	149
query27	2034	454	322	322
query28	5489	2471	2447	2447
query29	757	534	430	430
query30	225	178	151	151
query31	957	872	799	799
query32	88	57	61	57
query33	525	346	294	294
query34	796	819	488	488
query35	796	777	735	735
query36	1013	1026	937	937
query37	116	96	73	73
query38	4140	4130	3945	3945
query39	1460	1420	1379	1379
query40	202	112	103	103
query41	49	44	46	44
query42	123	112	98	98
query43	517	525	490	490
query44	1304	825	814	814
query45	174	168	166	166
query46	854	1027	631	631
query47	1860	1834	1831	1831
query48	381	404	318	318
query49	765	474	378	378
query50	602	643	384	384
query51	6880	6975	6899	6899
query52	104	98	90	90
query53	223	247	178	178
query54	469	484	412	412
query55	80	76	78	76
query56	254	268	239	239
query57	1130	1165	1071	1071
query58	239	221	221	221
query59	3054	3246	2971	2971
query60	268	261	243	243
query61	109	109	114	109
query62	827	795	719	719
query63	225	188	190	188
query64	4471	1019	641	641
query65	3268	3185	3161	3161
query66	1079	402	328	328
query67	15926	15679	15389	15389
query68	8372	696	511	511
query69	466	275	247	247
query70	1146	1161	1108	1108
query71	429	280	255	255
query72	6198	3837	3795	3795
query73	670	743	355	355
query74	9829	8841	9112	8841
query75	3810	3122	2619	2619
query76	3637	1169	747	747
query77	769	359	271	271
query78	10007	9884	9354	9354
query79	4502	781	579	579
query80	716	500	431	431
query81	484	259	226	226
query82	658	153	121	121
query83	201	174	149	149
query84	285	90	67	67
query85	750	449	298	298
query86	364	324	292	292
query87	4326	4434	4330	4330
query88	4331	2181	2146	2146
query89	429	319	290	290
query90	1918	193	187	187
query91	137	134	104	104
query92	73	57	58	57
query93	2223	868	523	523
query94	665	387	289	289
query95	331	276	250	250
query96	492	613	276	276
query97	2830	2926	2776	2776
query98	227	195	201	195
query99	1619	1624	1383	1383
Total cold run time: 293601 ms
Total hot run time: 187911 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.62 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 53389d73e2954eb7a2b39f2043627e216d7c08d5, data reload: false

query1	0.03	0.03	0.04
query2	0.08	0.03	0.03
query3	0.23	0.07	0.08
query4	1.65	0.11	0.11
query5	0.40	0.40	0.41
query6	1.15	0.65	0.65
query7	0.02	0.02	0.01
query8	0.03	0.03	0.03
query9	0.56	0.52	0.50
query10	0.55	0.57	0.55
query11	0.15	0.11	0.10
query12	0.13	0.11	0.11
query13	0.60	0.60	0.59
query14	2.73	2.74	2.78
query15	0.90	0.83	0.81
query16	0.36	0.38	0.40
query17	1.02	1.05	1.07
query18	0.22	0.22	0.20
query19	2.01	1.92	1.80
query20	0.02	0.01	0.01
query21	15.36	0.94	0.59
query22	0.75	0.92	0.58
query23	15.32	1.48	0.57
query24	2.53	1.20	1.61
query25	0.19	0.20	0.16
query26	0.30	0.13	0.13
query27	0.04	0.05	0.05
query28	14.09	1.52	1.05
query29	12.59	4.01	3.29
query30	0.25	0.09	0.06
query31	2.83	0.59	0.38
query32	3.22	0.56	0.46
query33	3.08	3.15	3.17
query34	16.98	5.12	4.55
query35	4.55	4.45	4.49
query36	0.64	0.48	0.49
query37	0.10	0.06	0.06
query38	0.05	0.03	0.04
query39	0.03	0.02	0.03
query40	0.18	0.13	0.12
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 106.07 s
Total hot run time: 31.62 s

@dqz123
Copy link

dqz123 commented Jan 8, 2025

run p0

1 similar comment
@dqz123
Copy link

dqz123 commented Jan 8, 2025

run p0

@dqz123
Copy link

dqz123 commented Jan 8, 2025

run p0

7 similar comments
@dqz123
Copy link

dqz123 commented Jan 8, 2025

run p0

@dqz123
Copy link

dqz123 commented Jan 8, 2025

run p0

@dqz123
Copy link

dqz123 commented Jan 8, 2025

run p0

@dqz123
Copy link

dqz123 commented Jan 8, 2025

run p0

@dqz123
Copy link

dqz123 commented Jan 8, 2025

run p0

@dqz123
Copy link

dqz123 commented Jan 9, 2025

run p0

@dqz123
Copy link

dqz123 commented Jan 9, 2025

run p0

garenshi added 2 commits January 9, 2025 12:04
@dqz123
Copy link

dqz123 commented Jan 9, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32697 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4a50befcb074cd520da31ac3c67ef24bbe404af9, data reload: false

------ Round 1 ----------------------------------
q1	17629	6219	6019	6019
q2	2055	309	183	183
q3	10528	1244	718	718
q4	10228	899	447	447
q5	7884	2126	1927	1927
q6	211	181	146	146
q7	876	762	604	604
q8	9238	1320	1190	1190
q9	5208	4885	4855	4855
q10	6753	2264	1839	1839
q11	503	280	262	262
q12	363	371	229	229
q13	17768	3703	3093	3093
q14	235	237	225	225
q15	563	513	487	487
q16	648	612	577	577
q17	568	855	331	331
q18	7250	6429	6460	6429
q19	1808	1038	579	579
q20	315	313	190	190
q21	2850	2190	2044	2044
q22	376	334	323	323
Total cold run time: 103857 ms
Total hot run time: 32697 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6251	6240	6251	6240
q2	245	327	229	229
q3	2257	2658	2335	2335
q4	1403	1784	1362	1362
q5	4332	4698	4855	4698
q6	201	184	148	148
q7	2070	1960	1842	1842
q8	2626	2837	2675	2675
q9	7186	7165	7191	7165
q10	3015	3316	2861	2861
q11	601	516	492	492
q12	668	788	614	614
q13	3437	3754	3298	3298
q14	272	297	264	264
q15	583	528	503	503
q16	677	666	662	662
q17	1236	1738	1315	1315
q18	7557	7502	7152	7152
q19	781	1128	1075	1075
q20	1976	1923	1845	1845
q21	5411	5048	4842	4842
q22	619	611	607	607
Total cold run time: 53404 ms
Total hot run time: 52224 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 187378 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4a50befcb074cd520da31ac3c67ef24bbe404af9, data reload: false

query1	960	370	372	370
query2	6531	2351	2279	2279
query3	6710	209	220	209
query4	33653	23358	23169	23169
query5	4355	603	469	469
query6	295	205	216	205
query7	4624	487	308	308
query8	306	246	239	239
query9	9419	2651	2643	2643
query10	478	310	276	276
query11	18431	15313	15304	15304
query12	167	108	105	105
query13	1673	541	421	421
query14	10785	6498	6489	6489
query15	244	198	190	190
query16	8121	589	431	431
query17	1551	724	550	550
query18	2113	389	282	282
query19	217	181	149	149
query20	121	117	117	117
query21	210	119	103	103
query22	4259	4254	4061	4061
query23	33650	32973	32823	32823
query24	6365	2258	2217	2217
query25	501	450	384	384
query26	1177	269	151	151
query27	2306	453	356	356
query28	5549	2418	2382	2382
query29	664	550	406	406
query30	223	187	143	143
query31	966	852	785	785
query32	98	60	58	58
query33	505	348	292	292
query34	808	813	524	524
query35	808	805	720	720
query36	1016	1008	942	942
query37	121	95	70	70
query38	4183	3977	4001	3977
query39	1515	1425	1435	1425
query40	203	113	99	99
query41	49	45	46	45
query42	128	104	104	104
query43	526	522	490	490
query44	1292	815	803	803
query45	179	163	165	163
query46	849	1053	654	654
query47	1809	1841	1788	1788
query48	374	394	322	322
query49	771	466	385	385
query50	630	660	391	391
query51	6820	6936	6929	6929
query52	106	102	92	92
query53	225	257	182	182
query54	474	489	394	394
query55	88	79	82	79
query56	263	266	239	239
query57	1184	1146	1072	1072
query58	246	235	242	235
query59	3133	3179	3139	3139
query60	284	272	260	260
query61	143	108	112	108
query62	828	741	732	732
query63	231	196	190	190
query64	4591	981	629	629
query65	3221	3087	3191	3087
query66	1036	410	303	303
query67	15800	15470	15487	15470
query68	7687	710	509	509
query69	469	288	245	245
query70	1179	1146	1023	1023
query71	443	284	250	250
query72	6131	3825	3871	3825
query73	643	748	360	360
query74	9426	8870	8951	8870
query75	3166	3130	2614	2614
query76	3341	1179	749	749
query77	583	353	285	285
query78	9867	9979	9348	9348
query79	2390	806	595	595
query80	722	500	417	417
query81	516	259	223	223
query82	338	147	127	127
query83	176	170	142	142
query84	243	90	69	69
query85	750	362	296	296
query86	394	308	301	301
query87	4284	4395	4260	4260
query88	4264	2153	2124	2124
query89	392	317	285	285
query90	1919	181	183	181
query91	135	130	103	103
query92	69	59	53	53
query93	2775	878	524	524
query94	674	387	294	294
query95	334	258	250	250
query96	491	606	281	281
query97	2798	2908	2797	2797
query98	233	199	200	199
query99	1439	1481	1371	1371
Total cold run time: 289432 ms
Total hot run time: 187378 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.6 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4a50befcb074cd520da31ac3c67ef24bbe404af9, data reload: false

query1	0.03	0.04	0.03
query2	0.07	0.04	0.04
query3	0.24	0.07	0.07
query4	1.61	0.11	0.11
query5	0.41	0.43	0.40
query6	1.16	0.66	0.66
query7	0.03	0.02	0.01
query8	0.04	0.03	0.03
query9	0.58	0.48	0.50
query10	0.55	0.55	0.54
query11	0.15	0.09	0.10
query12	0.13	0.11	0.11
query13	0.61	0.61	0.59
query14	2.80	2.85	2.84
query15	0.91	0.83	0.82
query16	0.38	0.37	0.39
query17	1.01	1.03	1.06
query18	0.22	0.20	0.20
query19	1.94	1.80	2.02
query20	0.02	0.01	0.02
query21	15.35	0.93	0.58
query22	0.77	0.94	0.67
query23	15.15	1.39	0.61
query24	2.95	1.26	2.15
query25	0.16	0.14	0.09
query26	0.33	0.15	0.13
query27	0.06	0.04	0.05
query28	14.46	1.49	1.05
query29	12.55	3.94	3.24
query30	0.25	0.09	0.07
query31	2.82	0.60	0.38
query32	3.22	0.54	0.47
query33	3.16	3.05	3.12
query34	16.89	5.13	4.46
query35	4.47	4.47	4.47
query36	0.64	0.48	0.48
query37	0.09	0.06	0.06
query38	0.04	0.03	0.03
query39	0.04	0.03	0.03
query40	0.16	0.14	0.13
query41	0.08	0.02	0.03
query42	0.03	0.02	0.03
query43	0.04	0.03	0.03
Total cold run time: 106.6 s
Total hot run time: 31.6 s

@morrySnow morrySnow closed this Jan 10, 2025
@morrySnow morrySnow reopened this Jan 10, 2025
@morrySnow morrySnow merged commit 977b334 into apache:master Jan 10, 2025
25 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants