Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

branch-3.0: [fix](nereids) fix compare with date like overflow #45868 #45922

Merged

Conversation

yujun777
Copy link
Collaborator

cherry pick from #45868

@yujun777
Copy link
Collaborator Author

run buildall

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@doris-robot
Copy link

TPC-H: Total hot run time: 40391 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 03500608e41b24973d28d28622b2745597b082a6, data reload: false

------ Round 1 ----------------------------------
q1	17569	7297	7261	7261
q2	2032	168	167	167
q3	10558	1123	1222	1123
q4	10232	722	691	691
q5	7760	2779	2822	2779
q6	235	144	144	144
q7	971	598	589	589
q8	9350	1871	1930	1871
q9	6585	6395	6337	6337
q10	6999	2275	2290	2275
q11	447	261	275	261
q12	398	212	209	209
q13	17790	2949	2951	2949
q14	242	201	204	201
q15	560	533	506	506
q16	665	625	617	617
q17	976	532	551	532
q18	7349	6502	6656	6502
q19	1386	966	1062	966
q20	485	203	199	199
q21	3990	3247	3236	3236
q22	1095	976	996	976
Total cold run time: 107674 ms
Total hot run time: 40391 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7184	7180	7168	7168
q2	331	226	223	223
q3	2891	2740	2751	2740
q4	1895	1653	1689	1653
q5	5373	5470	5432	5432
q6	223	134	135	134
q7	2120	1702	1714	1702
q8	3225	3398	3345	3345
q9	8517	8500	8497	8497
q10	3475	3451	3436	3436
q11	578	483	487	483
q12	777	564	614	564
q13	10525	3018	2988	2988
q14	291	260	253	253
q15	567	511	501	501
q16	692	655	670	655
q17	1790	1554	1561	1554
q18	7765	7553	7372	7372
q19	1634	1543	1504	1504
q20	2039	1791	1784	1784
q21	5263	5215	5233	5215
q22	1074	975	992	975
Total cold run time: 68229 ms
Total hot run time: 58178 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190106 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 03500608e41b24973d28d28622b2745597b082a6, data reload: false

query1	978	384	353	353
query2	6523	2110	2072	2072
query3	6709	215	216	215
query4	33830	23414	23532	23414
query5	4302	456	477	456
query6	260	173	168	168
query7	4621	303	304	303
query8	285	219	219	219
query9	9615	2679	2676	2676
query10	487	261	243	243
query11	18120	15198	15177	15177
query12	154	101	99	99
query13	1639	439	429	429
query14	10271	6487	6989	6487
query15	255	173	185	173
query16	8082	471	493	471
query17	1616	585	556	556
query18	2150	313	324	313
query19	385	156	148	148
query20	115	107	108	107
query21	67	54	46	46
query22	4458	4192	4132	4132
query23	34426	33892	33947	33892
query24	11673	2838	2843	2838
query25	678	407	414	407
query26	1730	169	163	163
query27	2860	306	296	296
query28	8246	2485	2423	2423
query29	1008	450	442	442
query30	321	168	165	165
query31	1024	822	822	822
query32	92	57	57	57
query33	786	292	304	292
query34	931	499	491	491
query35	862	726	712	712
query36	1103	967	943	943
query37	141	76	72	72
query38	4049	3837	3859	3837
query39	1471	1418	1402	1402
query40	231	89	85	85
query41	55	50	49	49
query42	109	99	99	99
query43	525	479	487	479
query44	1318	820	823	820
query45	185	171	168	168
query46	1126	703	702	702
query47	1901	1812	1811	1811
query48	454	383	380	380
query49	1252	396	396	396
query50	808	397	400	397
query51	7294	7106	6987	6987
query52	98	88	88	88
query53	256	183	181	181
query54	1305	463	462	462
query55	79	79	80	79
query56	282	259	260	259
query57	1226	1111	1095	1095
query58	245	206	227	206
query59	3150	3035	2903	2903
query60	290	297	256	256
query61	112	106	108	106
query62	873	662	657	657
query63	217	181	186	181
query64	5387	659	667	659
query65	3380	3180	3221	3180
query66	1529	317	342	317
query67	15832	15393	15451	15393
query68	5026	579	570	570
query69	426	261	275	261
query70	1194	1043	1068	1043
query71	406	255	256	255
query72	6511	4041	3733	3733
query73	766	344	357	344
query74	10331	9046	8991	8991
query75	3420	2622	2613	2613
query76	2928	1150	1149	1149
query77	464	267	270	267
query78	10465	9599	9663	9599
query79	1130	585	599	585
query80	731	438	428	428
query81	515	241	231	231
query82	1180	124	118	118
query83	242	142	150	142
query84	245	83	79	79
query85	1115	304	287	287
query86	316	299	307	299
query87	4483	4261	4299	4261
query88	3354	2385	2333	2333
query89	401	286	291	286
query90	2096	180	182	180
query91	183	142	149	142
query92	60	49	51	49
query93	1037	546	548	546
query94	790	299	259	259
query95	346	254	253	253
query96	601	280	275	275
query97	3263	3124	3215	3124
query98	217	197	191	191
query99	1520	1307	1329	1307
Total cold run time: 301604 ms
Total hot run time: 190106 ms

@yujun777
Copy link
Collaborator Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40550 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2843174a03f99350b6228ea047f2093d6922fbb0, data reload: false

------ Round 1 ----------------------------------
q1	17594	7461	7198	7198
q2	2048	169	167	167
q3	10648	1052	1205	1052
q4	10567	757	685	685
q5	7754	2842	2782	2782
q6	232	150	148	148
q7	981	630	610	610
q8	9342	1909	2009	1909
q9	6584	6425	6359	6359
q10	7012	2287	2312	2287
q11	467	262	259	259
q12	397	205	214	205
q13	17789	2961	2972	2961
q14	249	203	207	203
q15	573	514	528	514
q16	692	627	618	618
q17	961	564	571	564
q18	7279	6712	6761	6712
q19	1377	1032	1169	1032
q20	467	207	201	201
q21	3963	3285	3110	3110
q22	1087	974	986	974
Total cold run time: 108063 ms
Total hot run time: 40550 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7231	7204	7201	7201
q2	318	239	242	239
q3	2900	2938	2925	2925
q4	2048	1825	1806	1806
q5	5659	5705	5715	5705
q6	225	140	139	139
q7	2303	1793	1840	1793
q8	3357	3567	3542	3542
q9	8724	8831	8826	8826
q10	3571	3552	3512	3512
q11	604	495	500	495
q12	825	629	636	629
q13	10583	3147	3130	3130
q14	303	276	283	276
q15	570	536	516	516
q16	718	674	669	669
q17	1850	1632	1593	1593
q18	8262	7889	7697	7697
q19	1652	1594	1626	1594
q20	2117	1860	1907	1860
q21	5534	5263	5341	5263
q22	1113	1005	1038	1005
Total cold run time: 70467 ms
Total hot run time: 60415 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197617 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2843174a03f99350b6228ea047f2093d6922fbb0, data reload: false

query1	1279	914	901	901
query2	6220	2100	2099	2099
query3	10792	4392	4237	4237
query4	65505	28632	23459	23459
query5	4993	440	441	440
query6	406	185	193	185
query7	5486	304	302	302
query8	311	232	232	232
query9	8838	2685	2683	2683
query10	463	269	251	251
query11	17007	15290	15725	15290
query12	170	103	100	100
query13	1432	449	440	440
query14	10828	7250	7264	7250
query15	205	182	176	176
query16	7097	427	488	427
query17	1063	594	587	587
query18	1789	333	317	317
query19	208	163	159	159
query20	117	108	107	107
query21	56	47	44	44
query22	4936	4377	4608	4377
query23	34960	34430	34318	34318
query24	6080	2946	2855	2855
query25	537	413	404	404
query26	654	166	170	166
query27	1843	302	300	300
query28	4270	2517	2485	2485
query29	706	470	450	450
query30	245	172	171	171
query31	1014	842	855	842
query32	66	55	62	55
query33	486	281	284	281
query34	925	516	507	507
query35	844	793	745	745
query36	1087	950	980	950
query37	124	73	77	73
query38	4214	3955	4064	3955
query39	1530	1452	1459	1452
query40	138	82	83	82
query41	50	47	48	47
query42	110	101	97	97
query43	528	499	503	499
query44	1201	842	836	836
query45	185	165	167	165
query46	1165	721	752	721
query47	2014	1943	1964	1943
query48	485	375	382	375
query49	730	392	392	392
query50	835	417	415	415
query51	7282	7346	7202	7202
query52	103	86	87	86
query53	259	184	180	180
query54	590	447	469	447
query55	81	77	78	77
query56	259	259	239	239
query57	1229	1094	1077	1077
query58	211	201	199	199
query59	3078	2931	2972	2931
query60	276	249	252	249
query61	106	105	112	105
query62	763	647	657	647
query63	212	189	194	189
query64	1426	666	634	634
query65	3312	3213	3192	3192
query66	753	292	295	292
query67	15996	15701	15960	15701
query68	4110	579	573	573
query69	436	268	259	259
query70	1210	1122	1104	1104
query71	340	256	253	253
query72	6531	4011	4055	4011
query73	758	346	338	338
query74	10231	9003	9048	9003
query75	3325	2635	2637	2635
query76	1791	1122	1060	1060
query77	488	266	263	263
query78	10603	9669	9564	9564
query79	1490	601	586	586
query80	895	444	428	428
query81	513	247	240	240
query82	1255	116	117	116
query83	163	146	141	141
query84	279	80	72	72
query85	878	309	300	300
query86	340	295	295	295
query87	4432	4193	4361	4193
query88	3830	2379	2318	2318
query89	406	287	282	282
query90	1993	190	187	187
query91	183	149	145	145
query92	59	51	49	49
query93	1849	569	550	550
query94	768	300	300	300
query95	374	260	256	256
query96	610	278	272	272
query97	3387	3231	3223	3223
query98	218	195	204	195
query99	1577	1315	1327	1315
Total cold run time: 317485 ms
Total hot run time: 197617 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.77 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2843174a03f99350b6228ea047f2093d6922fbb0, data reload: false

query1	0.04	0.04	0.04
query2	0.07	0.03	0.04
query3	0.24	0.07	0.06
query4	1.62	0.10	0.10
query5	0.53	0.52	0.51
query6	1.14	0.73	0.74
query7	0.02	0.02	0.01
query8	0.04	0.04	0.03
query9	0.57	0.51	0.51
query10	0.56	0.56	0.57
query11	0.14	0.11	0.10
query12	0.14	0.11	0.13
query13	0.61	0.60	0.58
query14	3.01	3.01	2.92
query15	0.89	0.81	0.82
query16	0.38	0.38	0.38
query17	1.03	0.96	1.00
query18	0.23	0.22	0.22
query19	1.98	1.80	1.99
query20	0.01	0.02	0.01
query21	15.36	0.58	0.56
query22	3.09	2.68	1.95
query23	17.07	0.94	0.90
query24	3.25	1.98	0.76
query25	0.16	0.25	0.12
query26	0.54	0.14	0.13
query27	0.04	0.03	0.04
query28	9.80	1.10	1.07
query29	12.52	3.24	3.20
query30	0.24	0.06	0.06
query31	2.85	0.39	0.37
query32	3.29	0.47	0.46
query33	2.96	3.03	3.05
query34	17.09	4.45	4.47
query35	4.56	4.43	4.56
query36	0.67	0.49	0.47
query37	0.09	0.06	0.06
query38	0.04	0.04	0.04
query39	0.03	0.02	0.03
query40	0.16	0.13	0.12
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 107.21 s
Total hot run time: 32.77 s

@morrySnow morrySnow merged commit 3374363 into apache:branch-3.0 Dec 25, 2024
19 of 20 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants