Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

branch-3.0: [test](nereids) add arthmetic comparison ut #45690 #45894

Open
wants to merge 3 commits into
base: branch-3.0
Choose a base branch
from
Open

branch-3.0: [test](nereids) add arthmetic comparison ut #45690 #45894

wants to merge 3 commits into from
+150 −46

Conversation

yujun777
Copy link
Collaborator

cherry pick from #45690

@yujun777
[test](nereids) add arthmetic comparison ut (apache#45690)
936b12f 
### What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:
@yujun777
Copy link
Collaborator Author

run buildall

@Thearas
Copy link
Contributor

Thearas commented Dec 25, 2024

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@yujun777 yujun777 changed the title [test](nereids) add arthmetic comparison ut #45690 branch-3.0: [test](nereids) add arthmetic comparison ut #45690 Dec 25, 2024
@doris-robot
Copy link

TPC-H: Total hot run time: 40218 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 936b12f366941d6e1b5f6f6eea0b6ed5f41315d4, data reload: false

------ Round 1 ----------------------------------
q1	17631	7390	7236	7236
q2	2062	165	161	161
q3	10863	1065	1145	1065
q4	10560	730	707	707
q5	7743	2787	2780	2780
q6	236	145	143	143
q7	965	620	601	601
q8	9573	1903	1972	1903
q9	6979	6372	6364	6364
q10	6969	2268	2247	2247
q11	455	255	255	255
q12	391	217	205	205
q13	17801	2982	2994	2982
q14	241	201	211	201
q15	572	536	523	523
q16	654	595	608	595
q17	958	537	538	537
q18	7193	6605	6515	6515
q19	2489	1080	991	991
q20	477	208	200	200
q21	3918	3057	3025	3025
q22	1099	1005	982	982
Total cold run time: 109829 ms
Total hot run time: 40218 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7303	7197	7200	7197
q2	327	227	231	227
q3	2847	2857	2848	2848
q4	2001	1853	1785	1785
q5	5622	5688	5655	5655
q6	230	143	145	143
q7	2153	1765	1771	1765
q8	3302	3550	3502	3502
q9	8772	8799	8793	8793
q10	3528	3490	3500	3490
q11	601	502	497	497
q12	772	590	611	590
q13	16415	3120	3078	3078
q14	320	270	270	270
q15	561	518	527	518
q16	730	661	658	658
q17	1840	1636	1585	1585
q18	8108	7702	7397	7397
q19	6867	1552	1559	1552
q20	2101	1877	1849	1849
q21	5289	5207	5268	5207
q22	1153	1000	1001	1000
Total cold run time: 80842 ms
Total hot run time: 59606 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196014 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 936b12f366941d6e1b5f6f6eea0b6ed5f41315d4, data reload: false

query1	1321	951	921	921
query2	6248	2048	1996	1996
query3	10993	4302	4221	4221
query4	66991	28196	23655	23655
query5	5713	439	436	436
query6	515	197	178	178
query7	6105	316	304	304
query8	336	238	234	234
query9	9269	2732	2708	2708
query10	524	261	261	261
query11	18093	15327	15849	15327
query12	166	95	97	95
query13	1625	427	410	410
query14	11148	6512	6799	6512
query15	215	176	176	176
query16	7286	524	498	498
query17	1285	592	568	568
query18	1915	334	322	322
query19	233	156	154	154
query20	124	114	112	112
query21	67	47	44	44
query22	4667	4558	4564	4558
query23	34733	34339	34167	34167
query24	5767	2871	2919	2871
query25	541	425	423	423
query26	702	172	167	167
query27	1835	297	302	297
query28	4466	2576	2514	2514
query29	711	490	475	475
query30	256	176	175	175
query31	1045	809	851	809
query32	69	57	55	55
query33	444	309	303	303
query34	930	523	506	506
query35	841	765	737	737
query36	1111	965	953	953
query37	120	67	73	67
query38	4054	4086	3914	3914
query39	1517	1452	1498	1452
query40	137	74	78	74
query41	47	46	48	46
query42	116	93	102	93
query43	521	483	479	479
query44	1144	802	821	802
query45	190	164	171	164
query46	1153	716	729	716
query47	1989	1923	1879	1879
query48	456	357	362	357
query49	740	369	380	369
query50	812	408	405	405
query51	7412	7194	7218	7194
query52	100	89	86	86
query53	254	179	177	177
query54	555	450	428	428
query55	75	71	72	71
query56	266	234	231	231
query57	1210	1082	1074	1074
query58	208	201	199	199
query59	3136	2653	2929	2653
query60	280	253	240	240
query61	105	105	102	102
query62	762	654	686	654
query63	209	184	185	184
query64	1753	635	612	612
query65	3326	3206	3237	3206
query66	749	291	288	288
query67	15677	15801	15287	15287
query68	4821	556	567	556
query69	426	254	248	248
query70	1176	1126	1138	1126
query71	428	249	245	245
query72	6599	4002	4025	4002
query73	788	336	344	336
query74	10333	8922	8999	8922
query75	3441	2611	2651	2611
query76	2327	1048	1007	1007
query77	486	265	265	265
query78	11210	9840	9695	9695
query79	8389	593	599	593
query80	2088	416	416	416
query81	563	246	252	246
query82	1087	112	116	112
query83	259	149	142	142
query84	290	90	74	74
query85	1518	315	293	293
query86	467	307	304	304
query87	4552	4196	4204	4196
query88	5434	2515	2399	2399
query89	553	295	297	295
query90	2117	189	181	181
query91	184	141	142	141
query92	66	49	50	49
query93	6562	525	523	523
query94	839	284	295	284
query95	341	244	253	244
query96	624	289	281	281
query97	3368	3125	3191	3125
query98	226	200	198	198
query99	1660	1286	1260	1260
Total cold run time: 340585 ms
Total hot run time: 196014 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.36 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 936b12f366941d6e1b5f6f6eea0b6ed5f41315d4, data reload: false

query1	0.03	0.02	0.03
query2	0.07	0.04	0.03
query3	0.23	0.07	0.07
query4	1.63	0.10	0.10
query5	0.55	0.52	0.52
query6	1.14	0.73	0.73
query7	0.02	0.02	0.03
query8	0.04	0.03	0.03
query9	0.56	0.50	0.50
query10	0.54	0.55	0.55
query11	0.15	0.11	0.11
query12	0.14	0.11	0.11
query13	0.60	0.59	0.58
query14	2.98	3.10	3.02
query15	0.88	0.82	0.83
query16	0.36	0.37	0.38
query17	0.97	0.99	1.01
query18	0.23	0.22	0.21
query19	1.94	1.80	1.95
query20	0.02	0.01	0.02
query21	15.36	0.60	0.58
query22	2.84	2.76	1.44
query23	16.92	0.97	0.75
query24	3.40	1.07	1.02
query25	0.25	0.04	0.20
query26	0.49	0.13	0.14
query27	0.04	0.05	0.04
query28	10.68	1.10	1.07
query29	12.54	3.16	3.18
query30	0.24	0.06	0.06
query31	2.85	0.39	0.37
query32	3.27	0.45	0.48
query33	2.95	3.02	2.99
query34	17.15	4.40	4.44
query35	4.47	4.50	4.52
query36	0.68	0.48	0.49
query37	0.08	0.06	0.07
query38	0.05	0.03	0.04
query39	0.03	0.02	0.03
query40	0.15	0.12	0.12
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.02
Total cold run time: 107.67 s
Total hot run time: 32.36 s

@yujun777
Copy link
Collaborator Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41234 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d8150be472e6c999e3a26dd187f0b1f788c2c87a, data reload: false

------ Round 1 ----------------------------------
q1	18822	7501	7374	7374
q2	2553	179	172	172
q3	12118	1176	1257	1176
q4	10610	779	732	732
q5	8138	2919	2846	2846
q6	239	153	147	147
q7	1016	633	635	633
q8	9543	2031	2032	2031
q9	6691	6390	6438	6390
q10	7006	2341	2310	2310
q11	461	274	272	272
q12	407	215	212	212
q13	17783	2998	3037	2998
q14	235	204	214	204
q15	570	518	528	518
q16	652	612	610	610
q17	990	706	583	583
q18	7338	6615	6786	6615
q19	1420	1029	1024	1024
q20	490	208	212	208
q21	4171	3201	3215	3201
q22	1097	1015	978	978
Total cold run time: 112350 ms
Total hot run time: 41234 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7268	7211	7228	7211
q2	358	245	241	241
q3	3247	2989	2928	2928
q4	2081	1825	1774	1774
q5	5675	5766	5784	5766
q6	231	137	140	137
q7	2265	1800	1815	1800
q8	3344	3570	3519	3519
q9	8864	8877	8851	8851
q10	3654	3551	3537	3537
q11	600	533	503	503
q12	810	587	615	587
q13	6119	3072	3010	3010
q14	300	255	250	250
q15	556	513	503	503
q16	682	656	663	656
q17	1817	1608	1537	1537
q18	7963	7439	7378	7378
q19	1659	1589	1425	1425
q20	2071	1808	1769	1769
q21	5309	5193	5257	5193
q22	1062	986	973	973
Total cold run time: 65935 ms
Total hot run time: 59548 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191585 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d8150be472e6c999e3a26dd187f0b1f788c2c87a, data reload: false

query1	964	387	385	385
query2	6535	2072	2031	2031
query3	6709	213	221	213
query4	34236	23604	23489	23489
query5	4371	490	454	454
query6	288	193	181	181
query7	4617	326	326	326
query8	302	227	229	227
query9	9519	2697	2699	2697
query10	478	267	265	265
query11	18164	15224	15232	15224
query12	158	99	104	99
query13	1634	429	412	412
query14	9940	7352	6900	6900
query15	250	170	181	170
query16	8086	441	454	441
query17	1622	555	532	532
query18	2129	300	302	300
query19	344	147	145	145
query20	115	106	110	106
query21	67	44	44	44
query22	4366	4092	4307	4092
query23	34925	34226	34036	34036
query24	11213	2875	2901	2875
query25	650	417	415	415
query26	1180	174	169	169
query27	2841	295	302	295
query28	8111	2497	2445	2445
query29	864	453	443	443
query30	334	164	173	164
query31	1018	819	826	819
query32	98	57	59	57
query33	795	296	304	296
query34	943	496	536	496
query35	871	725	715	715
query36	1083	940	945	940
query37	142	79	76	76
query38	3971	3928	3832	3832
query39	1496	1464	1466	1464
query40	146	86	89	86
query41	53	51	49	49
query42	110	100	104	100
query43	527	486	490	486
query44	1304	812	813	812
query45	187	170	179	170
query46	1127	736	708	708
query47	1926	1824	1802	1802
query48	464	367	383	367
query49	1208	421	419	419
query50	828	413	416	413
query51	7168	7102	7092	7092
query52	102	100	94	94
query53	263	185	186	185
query54	1191	463	464	463
query55	79	81	78	78
query56	275	248	262	248
query57	1247	1130	1094	1094
query58	246	215	229	215
query59	3321	3159	2932	2932
query60	308	273	266	266
query61	136	134	134	134
query62	892	672	685	672
query63	222	194	195	194
query64	5586	753	619	619
query65	3332	3210	3188	3188
query66	1442	310	345	310
query67	16064	15558	15796	15558
query68	4526	591	572	572
query69	428	268	269	268
query70	1179	1073	1060	1060
query71	330	260	254	254
query72	6511	3986	4020	3986
query73	754	361	347	347
query74	10132	8922	8945	8922
query75	3440	2611	2627	2611
query76	2700	1119	1036	1036
query77	407	283	277	277
query78	10531	9653	9875	9653
query79	2116	613	618	613
query80	881	437	421	421
query81	544	241	236	236
query82	692	119	112	112
query83	256	145	147	145
query84	237	83	77	77
query85	1276	315	294	294
query86	408	291	291	291
query87	4430	4339	4319	4319
query88	4132	2378	2351	2351
query89	395	284	282	282
query90	2077	189	184	184
query91	181	146	149	146
query92	67	50	52	50
query93	1545	569	562	562
query94	942	291	306	291
query95	358	260	258	258
query96	615	282	285	282
query97	3331	3196	3173	3173
query98	213	208	195	195
query99	1504	1322	1293	1293
Total cold run time: 302321 ms
Total hot run time: 191585 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.99 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d8150be472e6c999e3a26dd187f0b1f788c2c87a, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.02	0.03
query3	0.23	0.06	0.07
query4	1.63	0.10	0.11
query5	0.53	0.50	0.51
query6	1.13	0.74	0.72
query7	0.02	0.02	0.02
query8	0.05	0.04	0.05
query9	0.56	0.51	0.51
query10	0.56	0.55	0.57
query11	0.14	0.11	0.10
query12	0.15	0.11	0.11
query13	0.62	0.60	0.60
query14	2.92	2.92	2.89
query15	0.91	0.83	0.82
query16	0.40	0.38	0.41
query17	1.06	1.03	1.04
query18	0.23	0.23	0.21
query19	1.94	1.88	2.05
query20	0.01	0.01	0.01
query21	15.39	0.58	0.60
query22	2.18	2.72	1.95
query23	17.12	0.86	0.64
query24	2.85	1.26	1.06
query25	0.27	0.13	0.19
query26	0.36	0.14	0.14
query27	0.04	0.05	0.03
query28	10.45	1.10	1.07
query29	12.57	3.23	3.20
query30	0.25	0.06	0.06
query31	2.87	0.39	0.37
query32	3.26	0.46	0.47
query33	3.03	3.01	3.06
query34	17.22	4.44	4.51
query35	4.48	4.48	4.49
query36	0.67	0.48	0.48
query37	0.09	0.06	0.06
query38	0.04	0.04	0.03
query39	0.03	0.02	0.02
query40	0.17	0.13	0.13
query41	0.07	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.68 s
Total hot run time: 32.99 s

@yujun777
Copy link
Collaborator Author

run cloud_p0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@yujun777 @Thearas @doris-robot