Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[feature](nereids)support CreateMaterializedViewCommand in nereids #45674

Open
wants to merge 2 commits into
base: master
Choose a base branch
from
Open

[feature](nereids)support CreateMaterializedViewCommand in nereids #45674

wants to merge 2 commits into from

Conversation

starocean999
Copy link
Contributor

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@starocean999
Copy link
Contributor Author

run buildall

@starocean999
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40506 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a3a9d1ba1c7ba1d21fadbaa98c65645daf98b4df, data reload: false

------ Round 1 ----------------------------------
q1	17635	8020	7425	7425
q2	2054	188	188	188
q3	10612	1222	1200	1200
q4	10301	781	779	779
q5	7639	2845	2711	2711
q6	241	149	145	145
q7	1007	628	615	615
q8	9249	1884	2014	1884
q9	6787	6524	6451	6451
q10	7042	2321	2322	2321
q11	456	260	269	260
q12	427	231	230	230
q13	17788	3026	3005	3005
q14	261	212	216	212
q15	571	504	508	504
q16	660	588	594	588
q17	1015	543	629	543
q18	7564	6857	6778	6778
q19	1379	1090	900	900
q20	461	189	183	183
q21	4141	3288	3269	3269
q22	374	315	318	315
Total cold run time: 107664 ms
Total hot run time: 40506 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7325	7364	7337	7337
q2	336	233	234	233
q3	3025	3076	3072	3072
q4	2090	1846	1838	1838
q5	5716	5676	5708	5676
q6	227	143	137	137
q7	2223	1819	1844	1819
q8	3467	3617	3561	3561
q9	9024	9043	9012	9012
q10	3642	3640	3571	3571
q11	613	526	502	502
q12	832	630	658	630
q13	12333	3088	3111	3088
q14	311	269	272	269
q15	598	527	499	499
q16	672	649	614	614
q17	1865	1597	1567	1567
q18	8255	7458	7549	7458
q19	1719	1535	1544	1535
q20	2067	1859	1848	1848
q21	5621	5299	5386	5299
q22	672	579	588	579
Total cold run time: 72633 ms
Total hot run time: 60144 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 189615 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a3a9d1ba1c7ba1d21fadbaa98c65645daf98b4df, data reload: false

query1	972	405	391	391
query2	6524	2390	2324	2324
query3	6701	221	214	214
query4	33722	23417	23497	23417
query5	4329	475	464	464
query6	283	178	198	178
query7	4622	312	319	312
query8	314	240	237	237
query9	9713	2712	2703	2703
query10	484	264	247	247
query11	17891	15150	15176	15150
query12	162	103	106	103
query13	1683	452	424	424
query14	9629	7379	6798	6798
query15	302	192	180	180
query16	8245	432	400	400
query17	1665	571	557	557
query18	2137	290	295	290
query19	360	152	152	152
query20	119	109	107	107
query21	232	104	99	99
query22	4349	4179	4349	4179
query23	34549	33417	33332	33332
query24	11460	2449	2436	2436
query25	668	380	390	380
query26	1852	153	154	153
query27	2920	336	332	332
query28	8096	2406	2399	2399
query29	1051	428	410	410
query30	306	149	148	148
query31	1143	784	834	784
query32	104	59	60	59
query33	772	292	285	285
query34	1045	524	534	524
query35	888	756	757	756
query36	1113	924	946	924
query37	278	79	73	73
query38	4196	4322	4131	4131
query39	1506	1426	1405	1405
query40	285	104	99	99
query41	48	44	45	44
query42	113	104	102	102
query43	538	511	495	495
query44	1282	834	811	811
query45	180	172	171	171
query46	1136	728	707	707
query47	1932	1836	1834	1834
query48	422	329	326	326
query49	1295	387	391	387
query50	820	387	381	381
query51	7219	6988	7092	6988
query52	104	98	90	90
query53	267	184	190	184
query54	1186	400	412	400
query55	82	81	79	79
query56	258	263	237	237
query57	1279	1091	1095	1091
query58	244	216	225	216
query59	3325	3311	3018	3018
query60	289	252	249	249
query61	109	112	104	104
query62	902	674	670	670
query63	224	193	196	193
query64	5063	701	660	660
query65	3266	3220	3247	3220
query66	1445	310	315	310
query67	15730	15918	15322	15322
query68	5703	548	559	548
query69	446	254	258	254
query70	1206	1210	1158	1158
query71	356	253	238	238
query72	6352	4120	4070	4070
query73	853	355	366	355
query74	10334	8896	8992	8896
query75	3429	2614	2621	2614
query76	3519	1007	1027	1007
query77	512	273	291	273
query78	10153	9445	10505	9445
query79	1815	621	605	605
query80	924	441	424	424
query81	528	236	223	223
query82	510	116	116	116
query83	245	147	144	144
query84	237	77	67	67
query85	1391	311	312	311
query86	448	268	300	268
query87	4435	4424	4446	4424
query88	3134	2231	2198	2198
query89	405	298	295	295
query90	2188	192	191	191
query91	152	123	125	123
query92	69	55	57	55
query93	1088	546	554	546
query94	1219	292	291	291
query95	364	250	250	250
query96	621	274	277	274
query97	2841	2600	2681	2600
query98	225	201	206	201
query99	1548	1329	1306	1306
Total cold run time: 302678 ms
Total hot run time: 189615 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.89 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a3a9d1ba1c7ba1d21fadbaa98c65645daf98b4df, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.03	0.04
query3	0.23	0.07	0.07
query4	1.62	0.10	0.11
query5	0.41	0.41	0.42
query6	1.16	0.65	0.64
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.59	0.49	0.50
query10	0.55	0.59	0.56
query11	0.14	0.11	0.11
query12	0.14	0.11	0.11
query13	0.61	0.61	0.60
query14	2.71	2.85	2.74
query15	0.91	0.83	0.82
query16	0.37	0.38	0.40
query17	1.02	1.04	1.05
query18	0.22	0.21	0.20
query19	1.92	1.85	2.05
query20	0.01	0.01	0.01
query21	15.37	0.60	0.59
query22	2.58	1.86	2.21
query23	16.98	0.92	0.89
query24	3.41	1.21	1.16
query25	0.21	0.14	0.07
query26	0.57	0.14	0.15
query27	0.05	0.04	0.05
query28	10.26	1.10	1.07
query29	12.61	3.22	3.22
query30	0.25	0.06	0.06
query31	2.86	0.40	0.38
query32	3.23	0.46	0.47
query33	3.15	3.12	3.03
query34	17.00	4.45	4.48
query35	4.46	4.45	4.44
query36	0.67	0.48	0.47
query37	0.09	0.06	0.06
query38	0.05	0.04	0.03
query39	0.04	0.03	0.03
query40	0.17	0.14	0.12
query41	0.08	0.03	0.03
query42	0.04	0.02	0.02
query43	0.03	0.04	0.03
Total cold run time: 106.95 s
Total hot run time: 32.89 s

@starocean999
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40008 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6f1d4209b5eda870299648c7a767ea576e8e84cb, data reload: false

------ Round 1 ----------------------------------
q1	17562	7413	7224	7224
q2	2043	183	167	167
q3	10700	1054	1177	1054
q4	10563	755	760	755
q5	7592	2692	2693	2692
q6	242	151	149	149
q7	981	624	606	606
q8	9266	1851	1910	1851
q9	6654	6405	6389	6389
q10	7065	2306	2301	2301
q11	475	258	247	247
q12	429	223	227	223
q13	17768	2950	2927	2927
q14	242	216	216	216
q15	562	494	513	494
q16	681	582	598	582
q17	1023	629	603	603
q18	7355	6820	6868	6820
q19	1343	1099	959	959
q20	466	185	183	183
q21	4140	3252	3355	3252
q22	372	325	314	314
Total cold run time: 107524 ms
Total hot run time: 40008 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7227	7219	7223	7219
q2	336	232	223	223
q3	2917	2802	2921	2802
q4	2066	1832	1772	1772
q5	5631	5657	5662	5657
q6	221	136	139	136
q7	2251	1830	1755	1755
q8	3354	3547	3498	3498
q9	8899	9128	8956	8956
q10	3587	3536	3511	3511
q11	606	495	535	495
q12	844	596	576	576
q13	12160	3164	3099	3099
q14	308	268	295	268
q15	569	498	504	498
q16	680	661	669	661
q17	1839	1603	1611	1603
q18	8292	7774	7628	7628
q19	1722	1457	1525	1457
q20	2084	1885	1850	1850
q21	5554	5515	5471	5471
q22	656	592	588	588
Total cold run time: 71803 ms
Total hot run time: 59723 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196477 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6f1d4209b5eda870299648c7a767ea576e8e84cb, data reload: false

query1	1293	997	887	887
query2	6245	2319	2278	2278
query3	10995	4723	4660	4660
query4	33410	23286	23281	23281
query5	4782	469	457	457
query6	294	193	202	193
query7	3986	299	314	299
query8	290	225	244	225
query9	9522	2683	2680	2680
query10	490	251	235	235
query11	17981	15220	15196	15196
query12	159	98	98	98
query13	1582	424	405	405
query14	9508	7637	7265	7265
query15	285	198	195	195
query16	8104	428	426	426
query17	1741	625	583	583
query18	2148	326	340	326
query19	387	177	179	177
query20	129	117	116	116
query21	217	116	113	113
query22	4809	4467	4632	4467
query23	34659	33634	33653	33634
query24	10304	2586	2500	2500
query25	581	393	424	393
query26	933	157	154	154
query27	2155	344	345	344
query28	6691	2443	2453	2443
query29	786	407	408	407
query30	228	150	153	150
query31	1017	850	850	850
query32	107	61	56	56
query33	774	326	305	305
query34	1160	554	515	515
query35	937	764	782	764
query36	1135	963	975	963
query37	124	82	74	74
query38	4501	4216	4420	4216
query39	1522	1453	1483	1453
query40	216	104	102	102
query41	45	45	45	45
query42	120	105	105	105
query43	537	479	466	466
query44	1334	838	841	838
query45	188	167	169	167
query46	1221	732	745	732
query47	2028	1934	1954	1934
query48	419	330	329	329
query49	880	421	390	390
query50	836	418	401	401
query51	7375	7098	7093	7093
query52	100	98	97	97
query53	272	188	186	186
query54	1157	418	416	416
query55	88	82	78	78
query56	256	235	242	235
query57	1287	1137	1175	1137
query58	239	230	237	230
query59	3234	3170	3209	3170
query60	278	255	255	255
query61	112	110	109	109
query62	872	683	686	683
query63	222	187	184	184
query64	3835	695	657	657
query65	3321	3197	3241	3197
query66	810	349	316	316
query67	16736	15615	15457	15457
query68	5864	568	552	552
query69	509	265	251	251
query70	1182	1154	1078	1078
query71	530	241	242	241
query72	7116	4177	4064	4064
query73	812	366	366	366
query74	10354	9035	8973	8973
query75	4199	2641	2632	2632
query76	4374	1153	1027	1027
query77	683	273	285	273
query78	10272	9497	9331	9331
query79	1126	601	600	600
query80	996	439	423	423
query81	514	248	232	232
query82	218	124	121	121
query83	193	154	141	141
query84	279	74	73	73
query85	1051	367	306	306
query86	374	312	301	301
query87	4620	4444	4336	4336
query88	3948	2217	2193	2193
query89	431	290	288	288
query90	2071	193	197	193
query91	142	104	107	104
query92	66	49	51	49
query93	2638	544	543	543
query94	830	274	283	274
query95	344	256	247	247
query96	633	273	273	273
query97	2871	2713	2695	2695
query98	208	194	203	194
query99	1601	1316	1311	1311
Total cold run time: 305038 ms
Total hot run time: 196477 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.7 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6f1d4209b5eda870299648c7a767ea576e8e84cb, data reload: false

query1	0.04	0.03	0.02
query2	0.07	0.03	0.03
query3	0.23	0.07	0.07
query4	1.62	0.10	0.10
query5	0.45	0.39	0.39
query6	1.17	0.64	0.64
query7	0.02	0.01	0.02
query8	0.05	0.04	0.03
query9	0.56	0.52	0.51
query10	0.56	0.58	0.56
query11	0.15	0.11	0.10
query12	0.13	0.11	0.11
query13	0.62	0.60	0.61
query14	2.70	2.72	2.77
query15	0.88	0.82	0.82
query16	0.40	0.37	0.37
query17	1.00	1.05	1.03
query18	0.24	0.20	0.21
query19	1.95	1.86	1.98
query20	0.01	0.01	0.01
query21	15.35	0.60	0.60
query22	2.66	2.30	1.64
query23	17.14	0.97	0.76
query24	3.26	1.35	2.21
query25	0.32	0.07	0.16
query26	0.54	0.15	0.14
query27	0.06	0.05	0.04
query28	9.19	1.13	1.07
query29	12.59	3.19	3.22
query30	0.25	0.06	0.06
query31	2.87	0.39	0.37
query32	3.28	0.46	0.46
query33	3.04	3.12	3.17
query34	16.96	4.46	4.44
query35	4.50	4.43	4.43
query36	0.71	0.47	0.47
query37	0.10	0.06	0.06
query38	0.05	0.04	0.04
query39	0.04	0.03	0.02
query40	0.16	0.13	0.12
query41	0.07	0.02	0.03
query42	0.04	0.02	0.03
query43	0.04	0.04	0.03
Total cold run time: 106.07 s
Total hot run time: 32.7 s

@starocean999 starocean999 marked this pull request as ready for review December 23, 2024 02:07
@starocean999
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32634 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0913b687f9f78b82c6094a7cb578cb2dd0c0b9fd, data reload: false

------ Round 1 ----------------------------------
q1	17604	6111	6051	6051
q2	2042	298	176	176
q3	10416	1231	733	733
q4	10215	874	419	419
q5	7602	2183	1975	1975
q6	208	183	146	146
q7	880	756	612	612
q8	9241	1362	1151	1151
q9	5145	4930	5006	4930
q10	6739	2300	1859	1859
q11	484	275	258	258
q12	352	357	229	229
q13	17771	3596	3015	3015
q14	229	226	209	209
q15	567	495	493	493
q16	636	618	574	574
q17	564	850	327	327
q18	7117	7007	6422	6422
q19	1844	971	572	572
q20	306	311	184	184
q21	2883	2212	1986	1986
q22	355	326	313	313
Total cold run time: 103200 ms
Total hot run time: 32634 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6245	6248	6248	6248
q2	242	323	228	228
q3	2245	2646	2319	2319
q4	1398	1831	1337	1337
q5	4331	4760	4829	4760
q6	181	187	149	149
q7	2080	1963	1849	1849
q8	2661	2826	2706	2706
q9	7352	7340	7327	7327
q10	3075	3393	2816	2816
q11	572	512	497	497
q12	703	846	624	624
q13	3378	3738	3061	3061
q14	308	307	300	300
q15	579	529	508	508
q16	656	685	666	666
q17	1208	1737	1279	1279
q18	7707	7436	7379	7379
q19	877	1180	1120	1120
q20	1986	2018	1930	1930
q21	5711	5292	4997	4997
q22	612	614	596	596
Total cold run time: 54107 ms
Total hot run time: 52696 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197843 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0913b687f9f78b82c6094a7cb578cb2dd0c0b9fd, data reload: false

query1	1285	967	921	921
query2	6510	2324	2351	2324
query3	11088	4923	4813	4813
query4	32802	23763	23899	23763
query5	4189	619	463	463
query6	276	189	193	189
query7	3988	512	318	318
query8	300	239	233	233
query9	9500	2756	2736	2736
query10	453	306	251	251
query11	18034	15408	15153	15153
query12	158	108	100	100
query13	1570	550	403	403
query14	10048	7246	7702	7246
query15	239	207	200	200
query16	8102	626	447	447
query17	1565	794	627	627
query18	2113	427	344	344
query19	212	207	171	171
query20	129	125	120	120
query21	209	128	112	112
query22	4617	4563	4369	4369
query23	35029	33688	33691	33688
query24	6454	2359	2423	2359
query25	459	463	387	387
query26	943	280	156	156
query27	2024	477	381	381
query28	5485	2515	2483	2483
query29	591	554	436	436
query30	211	184	159	159
query31	1005	929	835	835
query32	68	61	60	60
query33	481	360	290	290
query34	778	927	519	519
query35	823	835	757	757
query36	1089	1053	987	987
query37	120	100	78	78
query38	4174	4220	4300	4220
query39	1528	1496	1446	1446
query40	208	118	104	104
query41	45	42	43	42
query42	121	103	105	103
query43	528	536	503	503
query44	1347	816	858	816
query45	181	176	177	176
query46	929	1076	686	686
query47	2024	2031	1901	1901
query48	392	416	326	326
query49	737	497	396	396
query50	660	702	411	411
query51	7255	7336	7057	7057
query52	104	98	90	90
query53	227	270	214	214
query54	488	499	413	413
query55	90	84	77	77
query56	265	275	248	248
query57	1267	1198	1157	1157
query58	254	229	217	217
query59	3197	3346	3219	3219
query60	275	252	244	244
query61	123	105	108	105
query62	855	846	761	761
query63	235	207	203	203
query64	3159	1023	737	737
query65	3429	3271	3316	3271
query66	818	409	306	306
query67	16504	15715	15537	15537
query68	9106	777	522	522
query69	483	300	252	252
query70	1192	1161	1143	1143
query71	417	290	271	271
query72	6028	3849	3884	3849
query73	668	772	364	364
query74	10200	9527	9240	9240
query75	4650	3110	2679	2679
query76	4577	1212	833	833
query77	837	371	279	279
query78	10149	10208	9379	9379
query79	3640	908	591	591
query80	725	521	451	451
query81	495	267	237	237
query82	640	151	124	124
query83	199	161	142	142
query84	282	91	75	75
query85	852	513	308	308
query86	346	336	308	308
query87	4437	4388	4340	4340
query88	4378	2235	2212	2212
query89	427	338	320	320
query90	1877	187	189	187
query91	128	134	105	105
query92	62	56	51	51
query93	2062	929	538	538
query94	726	398	292	292
query95	338	265	251	251
query96	490	617	281	281
query97	2705	2827	2662	2662
query98	227	202	193	193
query99	1662	1576	1500	1500
Total cold run time: 299371 ms
Total hot run time: 197843 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.04 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0913b687f9f78b82c6094a7cb578cb2dd0c0b9fd, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.03
query3	0.24	0.07	0.06
query4	1.96	0.11	0.10
query5	0.44	0.42	0.42
query6	1.14	0.67	0.66
query7	0.02	0.02	0.01
query8	0.04	0.04	0.03
query9	0.56	0.53	0.50
query10	0.57	0.58	0.57
query11	0.15	0.10	0.11
query12	0.14	0.11	0.11
query13	0.61	0.60	0.61
query14	2.85	2.75	2.71
query15	0.90	0.83	0.82
query16	0.37	0.40	0.39
query17	1.03	0.98	1.05
query18	0.23	0.20	0.21
query19	1.87	1.88	1.99
query20	0.02	0.02	0.01
query21	15.36	0.97	0.59
query22	0.75	0.72	0.76
query23	15.28	1.50	0.55
query24	3.10	1.20	0.56
query25	0.28	0.23	0.06
query26	0.18	0.15	0.14
query27	0.06	0.05	0.05
query28	13.42	1.56	1.04
query29	12.56	3.94	3.28
query30	0.25	0.09	0.06
query31	2.82	0.62	0.40
query32	3.23	0.55	0.45
query33	3.16	3.14	3.05
query34	16.79	5.08	4.55
query35	4.51	4.58	4.51
query36	0.67	0.50	0.51
query37	0.09	0.06	0.06
query38	0.04	0.04	0.04
query39	0.04	0.02	0.02
query40	0.17	0.14	0.12
query41	0.08	0.03	0.03
query42	0.03	0.03	0.02
query43	0.04	0.04	0.03
Total cold run time: 106.15 s
Total hot run time: 31.04 s

@starocean999
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32581 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 506ae67bff3d4a1df6a13e469e50d998ff6dbb98, data reload: false

------ Round 1 ----------------------------------
q1	17576	6135	5967	5967
q2	2047	300	160	160
q3	10460	1219	771	771
q4	10214	862	431	431
q5	7615	2190	1981	1981
q6	206	185	148	148
q7	897	789	600	600
q8	9257	1337	1175	1175
q9	5256	4943	4944	4943
q10	6758	2301	1848	1848
q11	493	282	260	260
q12	356	362	218	218
q13	17785	3545	2992	2992
q14	224	224	217	217
q15	554	533	515	515
q16	649	638	603	603
q17	567	875	338	338
q18	7129	6800	6447	6447
q19	2193	972	546	546
q20	292	316	190	190
q21	2825	2104	1927	1927
q22	351	329	304	304
Total cold run time: 103704 ms
Total hot run time: 32581 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6284	6240	6219	6219
q2	242	321	233	233
q3	2253	2593	2335	2335
q4	1467	1876	1387	1387
q5	4359	4783	4757	4757
q6	185	176	140	140
q7	2064	1971	1841	1841
q8	2587	2783	2653	2653
q9	7247	7201	7372	7201
q10	3057	3367	2858	2858
q11	564	498	488	488
q12	641	720	622	622
q13	3482	3765	3157	3157
q14	292	316	274	274
q15	559	527	500	500
q16	660	678	651	651
q17	1215	1713	1268	1268
q18	7676	7610	7390	7390
q19	808	1004	1126	1004
q20	1970	2071	1951	1951
q21	5655	5299	4887	4887
q22	646	626	588	588
Total cold run time: 53913 ms
Total hot run time: 52404 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197230 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 506ae67bff3d4a1df6a13e469e50d998ff6dbb98, data reload: false

query1	1312	1001	915	915
query2	6342	2387	2305	2305
query3	11112	4794	4788	4788
query4	33290	23652	23369	23369
query5	4648	621	453	453
query6	294	200	202	200
query7	3996	497	307	307
query8	307	256	249	249
query9	9158	2744	2756	2744
query10	456	304	249	249
query11	17907	15495	15625	15495
query12	182	110	111	110
query13	1777	529	413	413
query14	12407	7380	7669	7380
query15	232	213	185	185
query16	7744	631	472	472
query17	1553	794	608	608
query18	2088	404	311	311
query19	210	184	161	161
query20	121	119	113	113
query21	230	127	102	102
query22	4563	4574	4543	4543
query23	34447	33449	33761	33449
query24	6074	2312	2293	2293
query25	494	457	392	392
query26	854	276	147	147
query27	2001	476	330	330
query28	5487	2534	2460	2460
query29	586	558	436	436
query30	214	184	156	156
query31	1002	920	837	837
query32	68	61	56	56
query33	486	366	291	291
query34	765	858	526	526
query35	836	832	787	787
query36	1040	1063	969	969
query37	113	102	73	73
query38	4248	4250	4383	4250
query39	1518	1454	1478	1454
query40	213	133	107	107
query41	48	44	43	43
query42	117	109	102	102
query43	540	534	494	494
query44	1310	814	825	814
query45	184	173	168	168
query46	873	1069	644	644
query47	1979	2001	1968	1968
query48	398	408	326	326
query49	699	494	409	409
query50	629	664	391	391
query51	7358	7338	7119	7119
query52	108	101	99	99
query53	233	257	188	188
query54	474	484	414	414
query55	83	82	80	80
query56	250	261	236	236
query57	1247	1256	1180	1180
query58	247	232	222	222
query59	3108	3297	3344	3297
query60	275	279	262	262
query61	114	156	111	111
query62	821	830	734	734
query63	226	197	194	194
query64	3215	1026	636	636
query65	3305	3325	3278	3278
query66	955	415	303	303
query67	16365	15833	15514	15514
query68	8790	751	507	507
query69	487	300	255	255
query70	1255	1173	1169	1169
query71	424	286	266	266
query72	5889	3799	3953	3799
query73	664	758	359	359
query74	9767	9034	8781	8781
query75	4673	3158	2647	2647
query76	5102	1191	783	783
query77	937	370	280	280
query78	9640	9809	9491	9491
query79	2307	969	586	586
query80	733	543	417	417
query81	478	277	242	242
query82	434	163	128	128
query83	192	159	145	145
query84	274	86	73	73
query85	756	378	318	318
query86	343	294	303	294
query87	4485	4388	4615	4388
query88	3230	2250	2206	2206
query89	405	335	301	301
query90	1940	193	189	189
query91	134	146	103	103
query92	64	57	54	54
query93	922	903	526	526
query94	649	400	311	311
query95	329	273	258	258
query96	494	610	283	283
query97	2745	2832	2694	2694
query98	217	196	204	196
query99	1639	1566	1470	1470
Total cold run time: 295934 ms
Total hot run time: 197230 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.56 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 506ae67bff3d4a1df6a13e469e50d998ff6dbb98, data reload: false

query1	0.04	0.04	0.04
query2	0.07	0.03	0.03
query3	0.23	0.07	0.07
query4	1.62	0.10	0.10
query5	0.41	0.43	0.41
query6	1.14	0.66	0.66
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.58	0.50	0.52
query10	0.56	0.58	0.57
query11	0.15	0.10	0.11
query12	0.15	0.12	0.11
query13	0.60	0.62	0.60
query14	2.84	2.81	2.71
query15	0.92	0.82	0.82
query16	0.38	0.38	0.38
query17	1.04	1.06	1.01
query18	0.22	0.21	0.21
query19	1.94	1.83	2.02
query20	0.01	0.00	0.01
query21	15.37	0.89	0.58
query22	0.78	1.02	0.67
query23	15.05	1.45	0.57
query24	3.01	1.19	1.97
query25	0.26	0.15	0.05
query26	0.21	0.14	0.13
query27	0.05	0.05	0.04
query28	14.25	1.47	1.05
query29	12.56	3.99	3.32
query30	0.25	0.09	0.06
query31	2.83	0.58	0.37
query32	3.23	0.56	0.46
query33	3.05	3.05	3.12
query34	16.62	5.20	4.55
query35	4.55	4.49	4.53
query36	0.64	0.49	0.48
query37	0.10	0.06	0.06
query38	0.04	0.04	0.03
query39	0.04	0.03	0.02
query40	0.16	0.13	0.12
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 106.16 s
Total hot run time: 31.56 s

@starocean999
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32542 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 506ae67bff3d4a1df6a13e469e50d998ff6dbb98, data reload: false

------ Round 1 ----------------------------------
q1	17647	7109	6072	6072
q2	2041	315	171	171
q3	10395	1248	697	697
q4	10228	872	435	435
q5	7514	2148	1969	1969
q6	203	182	148	148
q7	895	725	636	636
q8	9240	1365	1204	1204
q9	5250	4886	4946	4886
q10	6729	2309	1883	1883
q11	471	282	265	265
q12	342	349	229	229
q13	17774	3572	2916	2916
q14	238	252	211	211
q15	547	495	504	495
q16	627	627	606	606
q17	574	847	326	326
q18	7191	6379	6348	6348
q19	1241	967	569	569
q20	308	327	196	196
q21	2806	2183	1967	1967
q22	358	334	313	313
Total cold run time: 102619 ms
Total hot run time: 32542 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6227	6209	6263	6209
q2	229	320	232	232
q3	2241	2636	2336	2336
q4	1400	1850	1368	1368
q5	4329	4744	4787	4744
q6	182	179	146	146
q7	2138	2005	1814	1814
q8	2553	2782	2641	2641
q9	7259	7217	7158	7158
q10	3024	3334	2816	2816
q11	585	513	488	488
q12	673	763	598	598
q13	3337	3766	3089	3089
q14	301	301	295	295
q15	581	507	501	501
q16	659	688	672	672
q17	1178	1718	1230	1230
q18	7785	7522	7159	7159
q19	794	1126	1005	1005
q20	1895	1931	1832	1832
q21	5460	5023	4897	4897
q22	583	638	577	577
Total cold run time: 53413 ms
Total hot run time: 51807 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 189828 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 506ae67bff3d4a1df6a13e469e50d998ff6dbb98, data reload: false

query1	957	387	367	367
query2	6534	2478	2373	2373
query3	6709	232	207	207
query4	33981	23691	23503	23503
query5	4287	624	453	453
query6	278	193	179	179
query7	4626	519	301	301
query8	316	246	246	246
query9	9754	2754	2734	2734
query10	485	320	269	269
query11	18289	15428	15217	15217
query12	158	105	104	104
query13	1679	552	403	403
query14	10613	7275	6766	6766
query15	241	211	181	181
query16	8350	620	441	441
query17	1581	736	563	563
query18	2097	402	314	314
query19	225	184	166	166
query20	120	112	115	112
query21	208	124	139	124
query22	4120	4249	4226	4226
query23	34460	33353	33724	33353
query24	6427	2280	2277	2277
query25	493	450	376	376
query26	1204	265	149	149
query27	2049	477	328	328
query28	5192	2448	2419	2419
query29	712	540	402	402
query30	222	211	155	155
query31	1020	883	834	834
query32	103	58	60	58
query33	503	364	298	298
query34	764	850	500	500
query35	781	793	758	758
query36	1021	1037	949	949
query37	114	98	76	76
query38	4098	4218	4042	4042
query39	1496	1462	1440	1440
query40	203	116	99	99
query41	47	48	45	45
query42	111	99	104	99
query43	528	541	490	490
query44	1298	790	781	781
query45	182	171	163	163
query46	877	1038	643	643
query47	1879	1910	1855	1855
query48	373	404	323	323
query49	791	474	376	376
query50	661	653	387	387
query51	7166	7198	6936	6936
query52	102	101	89	89
query53	224	253	190	190
query54	473	489	404	404
query55	79	75	80	75
query56	280	263	241	241
query57	1213	1178	1076	1076
query58	237	222	238	222
query59	3066	3252	3224	3224
query60	275	267	254	254
query61	111	106	115	106
query62	871	792	781	781
query63	227	194	195	194
query64	4376	984	652	652
query65	3315	3201	3261	3201
query66	1052	405	318	318
query67	15849	15801	15399	15399
query68	9509	765	520	520
query69	474	296	256	256
query70	1257	1164	1154	1154
query71	460	286	255	255
query72	5837	3904	3848	3848
query73	835	763	365	365
query74	10328	9215	8966	8966
query75	4662	3158	2641	2641
query76	5671	1185	770	770
query77	1018	377	282	282
query78	9958	10272	9377	9377
query79	2510	922	609	609
query80	706	513	455	455
query81	483	268	226	226
query82	254	152	122	122
query83	194	162	160	160
query84	289	95	77	77
query85	746	377	306	306
query86	356	332	311	311
query87	4660	4415	4328	4328
query88	3464	2236	2210	2210
query89	409	333	299	299
query90	2075	189	186	186
query91	136	143	105	105
query92	74	58	52	52
query93	1133	876	520	520
query94	656	403	289	289
query95	339	258	251	251
query96	492	604	284	284
query97	2736	2833	2701	2701
query98	220	207	202	202
query99	1646	1550	1415	1415
Total cold run time: 295720 ms
Total hot run time: 189828 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.47 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 506ae67bff3d4a1df6a13e469e50d998ff6dbb98, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.03	0.03
query3	0.24	0.06	0.07
query4	1.62	0.11	0.10
query5	0.42	0.42	0.42
query6	1.16	0.64	0.66
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.57	0.51	0.51
query10	0.56	0.56	0.56
query11	0.15	0.10	0.10
query12	0.14	0.12	0.11
query13	0.62	0.61	0.60
query14	2.83	2.78	2.84
query15	0.89	0.84	0.84
query16	0.37	0.38	0.38
query17	1.02	1.00	1.03
query18	0.23	0.21	0.21
query19	1.97	2.00	1.77
query20	0.01	0.01	0.02
query21	15.38	0.94	0.60
query22	0.74	0.84	0.73
query23	15.17	1.43	0.60
query24	3.01	0.99	0.98
query25	0.24	0.08	0.11
query26	0.35	0.17	0.14
query27	0.05	0.07	0.07
query28	12.75	1.60	1.05
query29	12.57	3.91	3.24
query30	0.24	0.09	0.06
query31	2.83	0.60	0.37
query32	3.24	0.55	0.45
query33	3.11	3.11	3.16
query34	16.70	5.11	4.51
query35	4.55	4.49	4.49
query36	0.65	0.49	0.47
query37	0.11	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.03	0.03
query40	0.16	0.12	0.13
query41	0.08	0.03	0.03
query42	0.04	0.03	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.05 s
Total hot run time: 31.47 s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@dataroaring dataroaring Awaiting requested review from dataroaring dataroaring is a code owner

@CalvinKirs CalvinKirs Awaiting requested review from CalvinKirs CalvinKirs is a code owner

@morningman morningman Awaiting requested review from morningman morningman is a code owner

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@starocean999 @hello-stephen @doris-robot