[enhance](nereids) date_add, date_sub, date_diff, date_floor, date_ceil function implement Monotonic #44943

feiniaofeiafei · 2024-12-03T12:14:21Z

What problem does this PR solve?

date_add, date_sub, date_diff, date_floor, date_ceil function implement Monotonic, so we can do prune range partition for this functions, for example date_add(dt, 1) = '2024-01-01'

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

doris-robot · 2024-12-03T12:14:26Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

feiniaofeiafei · 2024-12-03T12:16:15Z

run buildall

doris-robot · 2024-12-03T12:46:58Z

TPC-H: Total hot run time: 40040 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 43182b7427ea492c23213ae078648cbbbf9e56e4, data reload: false

------ Round 1 ----------------------------------
q1	17570	7525	7287	7287
q2	2052	176	165	165
q3	10586	1080	1169	1080
q4	10588	759	761	759
q5	7641	2689	2687	2687
q6	237	151	151	151
q7	995	631	638	631
q8	9238	1823	1882	1823
q9	6583	6488	6501	6488
q10	7045	2309	2326	2309
q11	465	276	279	276
q12	443	221	224	221
q13	17791	3046	3037	3037
q14	246	211	206	206
q15	574	534	522	522
q16	665	582	574	574
q17	982	592	566	566
q18	7148	6708	6687	6687
q19	1337	1008	964	964
q20	464	171	172	171
q21	4110	3125	3151	3125
q22	365	311	313	311
Total cold run time: 107125 ms
Total hot run time: 40040 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7242	7279	7271	7271
q2	322	230	233	230
q3	2856	2763	2910	2763
q4	2063	1801	1795	1795
q5	5676	5695	5638	5638
q6	224	143	147	143
q7	2248	1805	1819	1805
q8	3373	3551	3463	3463
q9	8929	9031	8979	8979
q10	3561	3533	3549	3533
q11	611	510	501	501
q12	850	630	597	597
q13	12496	3229	3227	3227
q14	303	272	268	268
q15	579	517	525	517
q16	681	630	629	629
q17	1837	1615	1586	1586
q18	8157	7858	7682	7682
q19	1692	1469	1613	1469
q20	2114	1888	1853	1853
q21	5480	5478	5394	5394
q22	650	602	553	553
Total cold run time: 71944 ms
Total hot run time: 59896 ms

doris-robot · 2024-12-03T12:59:38Z

TPC-DS: Total hot run time: 197571 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 43182b7427ea492c23213ae078648cbbbf9e56e4, data reload: false

query1	1246	968	954	954
query2	6249	2057	2029	2029
query3	10976	4474	4462	4462
query4	66721	28321	23562	23562
query5	4911	474	453	453
query6	411	184	186	184
query7	5524	299	291	291
query8	320	238	229	229
query9	8596	2699	2675	2675
query10	445	249	241	241
query11	17138	15267	15769	15267
query12	155	105	105	105
query13	1473	432	431	431
query14	10813	7934	7295	7295
query15	223	199	198	198
query16	7103	477	513	477
query17	1078	597	561	561
query18	1812	303	294	294
query19	203	153	156	153
query20	129	109	112	109
query21	213	127	103	103
query22	4649	4534	4321	4321
query23	36368	34539	35147	34539
query24	5378	2524	2527	2524
query25	496	398	386	386
query26	677	158	144	144
query27	1920	282	287	282
query28	4637	2490	2472	2472
query29	657	414	406	406
query30	213	156	149	149
query31	1050	863	820	820
query32	70	53	56	53
query33	427	284	288	284
query34	942	522	543	522
query35	915	764	779	764
query36	1074	970	938	938
query37	121	75	73	73
query38	4563	4396	4337	4337
query39	1549	1512	1522	1512
query40	200	103	100	100
query41	43	43	45	43
query42	110	100	101	100
query43	524	487	477	477
query44	1240	820	813	813
query45	193	173	168	168
query46	1196	728	716	716
query47	2069	1939	1919	1919
query48	412	312	311	311
query49	732	390	402	390
query50	845	403	409	403
query51	7435	7284	7238	7238
query52	96	89	89	89
query53	253	181	177	177
query54	505	401	395	395
query55	78	77	74	74
query56	246	230	231	230
query57	1250	1143	1099	1099
query58	211	225	220	220
query59	3217	3021	2919	2919
query60	269	240	235	235
query61	111	109	105	105
query62	775	672	686	672
query63	217	195	191	191
query64	1764	663	634	634
query65	3281	3172	3205	3172
query66	664	302	298	298
query67	15941	15717	15624	15624
query68	3927	585	566	566
query69	420	258	252	252
query70	1183	1172	1120	1120
query71	349	245	237	237
query72	6101	4063	4128	4063
query73	766	356	365	356
query74	10043	9025	9039	9025
query75	3422	2672	2671	2671
query76	1916	1180	1177	1177
query77	480	284	277	277
query78	10573	9500	9377	9377
query79	1440	602	597	597
query80	874	434	431	431
query81	478	238	224	224
query82	1283	124	120	120
query83	254	147	140	140
query84	279	71	72	71
query85	908	302	302	302
query86	335	306	293	293
query87	4683	4554	4651	4554
query88	3591	2205	2192	2192
query89	424	297	287	287
query90	1932	191	187	187
query91	138	102	102	102
query92	69	52	49	49
query93	1902	544	543	543
query94	745	298	293	293
query95	360	250	254	250
query96	633	279	280	279
query97	2833	2672	2640	2640
query98	210	194	198	194
query99	1611	1291	1320	1291
Total cold run time: 319484 ms
Total hot run time: 197571 ms

doris-robot · 2024-12-03T13:05:08Z

ClickBench: Total hot run time: 33 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 43182b7427ea492c23213ae078648cbbbf9e56e4, data reload: false

query1	0.04	0.03	0.04
query2	0.07	0.03	0.03
query3	0.23	0.07	0.06
query4	1.62	0.10	0.10
query5	0.43	0.41	0.43
query6	1.14	0.67	0.66
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.58	0.50	0.49
query10	0.57	0.57	0.57
query11	0.14	0.10	0.11
query12	0.14	0.11	0.10
query13	0.61	0.61	0.61
query14	2.82	2.74	2.77
query15	0.89	0.82	0.82
query16	0.40	0.38	0.38
query17	1.07	1.04	1.06
query18	0.22	0.22	0.21
query19	1.96	1.84	1.95
query20	0.02	0.02	0.01
query21	15.36	0.60	0.59
query22	2.53	2.29	1.69
query23	16.85	1.14	0.77
query24	3.89	1.73	1.50
query25	0.24	0.07	0.14
query26	0.71	0.13	0.15
query27	0.04	0.04	0.05
query28	9.40	1.10	1.07
query29	12.55	3.24	3.24
query30	0.25	0.06	0.08
query31	2.86	0.38	0.40
query32	3.25	0.49	0.48
query33	2.98	3.08	3.06
query34	16.90	4.42	4.42
query35	4.49	4.50	4.47
query36	0.65	0.49	0.47
query37	0.09	0.06	0.06
query38	0.05	0.03	0.03
query39	0.03	0.02	0.02
query40	0.17	0.13	0.13
query41	0.08	0.02	0.03
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 106.45 s
Total hot run time: 33 s

feiniaofeiafei · 2024-12-04T03:21:05Z

run buildall

doris-robot · 2024-12-04T05:09:45Z

TPC-H: Total hot run time: 41557 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c1871b2b82b2df8b8df422b67d2b896359ae45cf, data reload: false

------ Round 1 ----------------------------------
q1	17625	7906	7738	7738
q2	2052	178	171	171
q3	10641	1138	1269	1138
q4	10579	851	763	763
q5	7647	2855	2826	2826
q6	259	150	146	146
q7	1035	622	585	585
q8	9246	1946	2022	1946
q9	6806	6747	6697	6697
q10	7080	2333	2321	2321
q11	463	259	249	249
q12	462	226	219	219
q13	17781	3050	3019	3019
q14	241	217	222	217
q15	583	525	528	525
q16	626	569	579	569
q17	1021	601	590	590
q18	7399	6833	6783	6783
q19	1334	1176	1202	1176
q20	491	187	180	180
q21	4185	3407	3392	3392
q22	382	313	307	307
Total cold run time: 107938 ms
Total hot run time: 41557 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7710	7681	7775	7681
q2	348	227	239	227
q3	3167	3017	3041	3017
q4	2270	1892	1830	1830
q5	5715	5750	5788	5750
q6	245	146	145	145
q7	2301	1837	1818	1818
q8	3466	3744	3589	3589
q9	9207	9210	9237	9210
q10	3743	3660	3658	3658
q11	607	487	489	487
q12	850	567	635	567
q13	9626	3235	3224	3224
q14	300	276	287	276
q15	587	534	531	531
q16	701	624	640	624
q17	1988	1700	1694	1694
q18	8265	7853	7677	7677
q19	1875	1734	1733	1733
q20	2159	1879	1908	1879
q21	5971	5596	5616	5596
q22	652	548	571	548
Total cold run time: 71753 ms
Total hot run time: 61761 ms

doris-robot · 2024-12-04T05:22:22Z

TPC-DS: Total hot run time: 197407 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c1871b2b82b2df8b8df422b67d2b896359ae45cf, data reload: false

query1	1245	961	971	961
query2	6241	2128	2069	2069
query3	11134	4616	4528	4528
query4	68033	28726	23890	23890
query5	5022	468	447	447
query6	425	187	184	184
query7	5553	301	297	297
query8	332	242	236	236
query9	8803	2642	2621	2621
query10	457	268	250	250
query11	17359	15371	15847	15371
query12	158	105	105	105
query13	1517	452	417	417
query14	10757	7178	7075	7075
query15	225	210	196	196
query16	6799	509	512	509
query17	1088	559	564	559
query18	1261	318	297	297
query19	198	159	171	159
query20	116	107	107	107
query21	205	108	116	108
query22	4714	4666	4615	4615
query23	34734	34323	35111	34323
query24	5416	2504	2446	2446
query25	484	397	388	388
query26	649	155	159	155
query27	1905	292	286	286
query28	4532	2467	2474	2467
query29	671	415	398	398
query30	205	160	156	156
query31	991	826	856	826
query32	71	54	56	54
query33	447	318	294	294
query34	942	518	536	518
query35	871	760	754	754
query36	1084	958	944	944
query37	121	73	71	71
query38	4667	4380	4392	4380
query39	1542	1484	1489	1484
query40	195	101	103	101
query41	43	42	42	42
query42	119	101	96	96
query43	536	484	491	484
query44	1192	823	833	823
query45	192	171	171	171
query46	1177	742	715	715
query47	2041	1943	1946	1943
query48	414	324	310	310
query49	715	400	389	389
query50	838	397	393	393
query51	7470	7108	7032	7032
query52	105	89	94	89
query53	255	173	176	173
query54	501	405	400	400
query55	78	76	75	75
query56	266	230	253	230
query57	1264	1132	1107	1107
query58	212	205	203	203
query59	3173	3058	2871	2871
query60	263	238	250	238
query61	107	129	112	112
query62	746	702	664	664
query63	208	187	181	181
query64	1353	671	640	640
query65	3293	3172	3196	3172
query66	660	314	296	296
query67	16005	15640	15592	15592
query68	4240	571	574	571
query69	429	246	257	246
query70	1191	1141	1031	1031
query71	335	256	247	247
query72	6246	4159	4057	4057
query73	766	361	350	350
query74	10340	9045	9010	9010
query75	3393	2657	2649	2649
query76	1869	1078	1039	1039
query77	490	270	262	262
query78	10521	9499	9435	9435
query79	1100	590	578	578
query80	789	449	532	449
query81	470	239	231	231
query82	963	122	115	115
query83	163	139	147	139
query84	282	84	72	72
query85	827	304	297	297
query86	333	307	311	307
query87	4683	4553	4641	4553
query88	3445	2170	2150	2150
query89	414	305	286	286
query90	2042	185	184	184
query91	136	100	102	100
query92	66	50	49	49
query93	1110	539	558	539
query94	758	284	297	284
query95	349	241	245	241
query96	613	278	273	273
query97	2834	2655	2669	2655
query98	212	188	192	188
query99	1566	1333	1347	1333
Total cold run time: 317370 ms
Total hot run time: 197407 ms

doris-robot · 2024-12-04T05:27:53Z

ClickBench: Total hot run time: 32.92 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c1871b2b82b2df8b8df422b67d2b896359ae45cf, data reload: false

query1	0.04	0.03	0.04
query2	0.07	0.03	0.03
query3	0.23	0.07	0.07
query4	1.62	0.11	0.10
query5	0.41	0.41	0.42
query6	1.18	0.67	0.65
query7	0.02	0.02	0.02
query8	0.04	0.03	0.02
query9	0.58	0.52	0.52
query10	0.56	0.55	0.56
query11	0.15	0.10	0.10
query12	0.13	0.11	0.11
query13	0.61	0.60	0.60
query14	2.72	2.85	2.76
query15	0.90	0.84	0.82
query16	0.37	0.38	0.38
query17	1.03	1.00	1.01
query18	0.21	0.21	0.20
query19	1.98	1.85	1.92
query20	0.01	0.01	0.01
query21	15.35	0.60	0.62
query22	2.60	2.59	2.37
query23	16.93	0.83	0.76
query24	3.87	1.48	0.63
query25	0.22	0.30	0.13
query26	0.61	0.14	0.14
query27	0.05	0.04	0.05
query28	10.36	1.10	1.07
query29	12.54	3.22	3.18
query30	0.25	0.07	0.07
query31	2.85	0.39	0.37
query32	3.28	0.47	0.45
query33	3.00	3.04	3.04
query34	17.07	4.49	4.51
query35	4.55	4.56	4.62
query36	0.67	0.48	0.50
query37	0.09	0.06	0.06
query38	0.04	0.04	0.03
query39	0.03	0.02	0.02
query40	0.18	0.13	0.14
query41	0.07	0.02	0.02
query42	0.04	0.02	0.02
query43	0.03	0.04	0.03
Total cold run time: 107.54 s
Total hot run time: 32.92 s

morrySnow · 2024-12-05T06:26:54Z

...-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/DayCeil.java

+                return new DayCeil(literal, child(1), child(2));
+            default:
+                // should not reach
+                return null;


Do LOG

throw exception or check null in caller

…ty, then directly return result.

github-actions · 2024-12-18T15:02:07Z

PR approved by at least one committer and no changes requested.

github-actions · 2024-12-18T15:02:09Z

PR approved by anyone and no changes requested.

feiniaofeiafei · 2024-12-19T02:54:36Z

run buildall

doris-robot · 2024-12-19T03:44:23Z

TPC-H: Total hot run time: 39518 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d0f566bcb391d957f7b25173f4f38e14f3ea49df, data reload: false

------ Round 1 ----------------------------------
q1	17592	7421	7214	7214
q2	2049	175	162	162
q3	10615	1073	1134	1073
q4	10569	744	735	735
q5	7591	2688	2709	2688
q6	241	148	146	146
q7	965	634	613	613
q8	9252	1798	1911	1798
q9	6562	6447	6421	6421
q10	7062	2322	2286	2286
q11	482	274	268	268
q12	429	223	227	223
q13	18250	2888	2923	2888
q14	251	213	213	213
q15	566	512	491	491
q16	661	594	607	594
q17	982	490	551	490
q18	7124	6662	6637	6637
q19	1345	1052	939	939
q20	469	186	188	186
q21	4032	3359	3141	3141
q22	375	318	312	312
Total cold run time: 107464 ms
Total hot run time: 39518 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7324	7178	7198	7178
q2	334	231	229	229
q3	2885	2742	2932	2742
q4	2089	1855	1830	1830
q5	5701	5641	5636	5636
q6	221	139	142	139
q7	2264	1795	1823	1795
q8	3423	3545	3458	3458
q9	8922	9003	8920	8920
q10	3607	3538	3547	3538
q11	606	505	502	502
q12	829	585	603	585
q13	13190	3150	3093	3093
q14	308	293	275	275
q15	568	517	515	515
q16	714	633	633	633
q17	1828	1621	1614	1614
q18	8319	7822	7769	7769
q19	1771	1526	1431	1431
q20	2113	1864	1909	1864
q21	5562	5390	5419	5390
q22	661	597	598	597
Total cold run time: 73239 ms
Total hot run time: 59733 ms

doris-robot · 2024-12-19T03:56:44Z

TPC-DS: Total hot run time: 195875 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d0f566bcb391d957f7b25173f4f38e14f3ea49df, data reload: false

query1	1320	945	907	907
query2	6228	2332	2360	2332
query3	10923	4325	4763	4325
query4	33408	23598	23366	23366
query5	4213	464	460	460
query6	286	195	203	195
query7	4002	310	301	301
query8	323	263	222	222
query9	9368	2691	2690	2690
query10	479	242	238	238
query11	17697	15102	15373	15102
query12	153	109	104	104
query13	1560	429	422	422
query14	9420	6506	8523	6506
query15	288	196	202	196
query16	7774	499	455	455
query17	1757	611	589	589
query18	1502	331	336	331
query19	386	179	171	171
query20	123	114	119	114
query21	210	108	113	108
query22	4719	4521	4658	4521
query23	36049	33774	35364	33774
query24	11549	2634	2695	2634
query25	567	474	408	408
query26	748	164	158	158
query27	2237	341	349	341
query28	8013	2426	2449	2426
query29	671	420	425	420
query30	228	155	151	151
query31	1021	835	848	835
query32	92	56	55	55
query33	749	299	293	293
query34	998	539	541	539
query35	879	749	764	749
query36	1114	949	997	949
query37	123	74	73	73
query38	4162	4351	4260	4260
query39	1678	1497	1462	1462
query40	195	99	99	99
query41	47	41	43	41
query42	114	98	97	97
query43	527	496	495	495
query44	1258	816	832	816
query45	192	178	171	171
query46	1178	758	715	715
query47	2054	1925	1930	1925
query48	439	329	337	329
query49	890	376	420	376
query50	828	425	398	398
query51	7411	7275	7259	7259
query52	104	96	96	96
query53	261	190	193	190
query54	1208	423	414	414
query55	81	75	81	75
query56	270	235	235	235
query57	1280	1177	1155	1155
query58	228	225	231	225
query59	3350	3040	3077	3040
query60	271	267	240	240
query61	111	106	111	106
query62	856	676	697	676
query63	225	194	196	194
query64	3942	675	639	639
query65	3334	3222	3245	3222
query66	755	301	309	301
query67	16352	15697	15550	15550
query68	6008	557	537	537
query69	504	266	256	256
query70	1110	1126	1065	1065
query71	463	255	248	248
query72	6810	4082	4041	4041
query73	798	363	354	354
query74	9669	8792	8881	8792
query75	3634	2639	2653	2639
query76	3965	987	1023	987
query77	670	318	281	281
query78	10700	9382	9855	9382
query79	2540	620	613	613
query80	1111	430	428	428
query81	507	231	235	231
query82	622	120	113	113
query83	197	137	227	137
query84	285	72	68	68
query85	1249	307	300	300
query86	441	302	304	302
query87	4501	4491	4636	4491
query88	3861	2226	2183	2183
query89	427	304	287	287
query90	1874	192	184	184
query91	137	107	106	106
query92	64	49	57	49
query93	2059	550	543	543
query94	697	296	287	287
query95	346	252	254	252
query96	619	272	281	272
query97	2897	2678	2681	2678
query98	225	199	202	199
query99	1630	1340	1309	1309
Total cold run time: 305398 ms
Total hot run time: 195875 ms

doris-robot · 2024-12-19T04:02:15Z

ClickBench: Total hot run time: 33.32 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d0f566bcb391d957f7b25173f4f38e14f3ea49df, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.03	0.04
query3	0.23	0.08	0.07
query4	1.61	0.10	0.10
query5	0.43	0.42	0.42
query6	1.15	0.65	0.65
query7	0.02	0.01	0.01
query8	0.03	0.04	0.03
query9	0.60	0.50	0.51
query10	0.55	0.57	0.56
query11	0.15	0.11	0.11
query12	0.15	0.12	0.11
query13	0.60	0.61	0.61
query14	2.73	2.86	2.78
query15	0.88	0.82	0.82
query16	0.37	0.38	0.38
query17	1.06	1.06	1.06
query18	0.24	0.21	0.21
query19	1.96	1.87	1.99
query20	0.02	0.01	0.01
query21	15.36	0.60	0.59
query22	2.65	2.26	2.05
query23	16.90	1.00	0.82
query24	3.18	1.15	1.41
query25	0.17	0.24	0.23
query26	0.46	0.13	0.14
query27	0.04	0.03	0.06
query28	10.29	1.12	1.09
query29	12.61	3.26	3.23
query30	0.25	0.06	0.06
query31	2.86	0.38	0.39
query32	3.26	0.47	0.45
query33	3.10	3.08	3.07
query34	16.96	4.44	4.44
query35	4.46	4.47	4.51
query36	0.68	0.48	0.47
query37	0.10	0.07	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.02
query40	0.16	0.12	0.12
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.03	0.04	0.03
Total cold run time: 106.61 s
Total hot run time: 33.32 s

feiniaofeiafei · 2024-12-19T04:10:51Z

run buildall

doris-robot · 2024-12-19T04:30:03Z

TPC-H: Total hot run time: 39489 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f1d448401189e6fec15a56def24610f39d2edf42, data reload: false

------ Round 1 ----------------------------------
q1	17631	7373	7290	7290
q2	2045	180	173	173
q3	10541	1121	1205	1121
q4	10218	710	655	655
q5	7606	2694	2547	2547
q6	235	148	142	142
q7	997	617	627	617
q8	9231	1810	1919	1810
q9	6562	6400	6368	6368
q10	6971	2275	2284	2275
q11	454	262	268	262
q12	411	229	223	223
q13	17779	2938	2976	2938
q14	244	221	218	218
q15	558	519	492	492
q16	664	585	592	585
q17	963	530	507	507
q18	7369	6744	6619	6619
q19	1348	1095	982	982
q20	471	182	185	182
q21	4457	3208	3179	3179
q22	372	304	313	304
Total cold run time: 107127 ms
Total hot run time: 39489 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7221	7222	7200	7200
q2	331	229	231	229
q3	2896	2765	2973	2765
q4	2119	1863	1856	1856
q5	5563	5679	5602	5602
q6	226	141	137	137
q7	2174	1812	1725	1725
q8	3343	3567	3489	3489
q9	8895	8868	8802	8802
q10	3606	3535	3515	3515
q11	617	498	493	493
q12	853	619	609	609
q13	13173	3086	3185	3086
q14	306	269	272	269
q15	567	511	517	511
q16	663	676	634	634
q17	1817	1625	1617	1617
q18	7891	7538	7455	7455
q19	1675	1573	1517	1517
q20	2080	1824	1855	1824
q21	5260	5325	5260	5260
q22	645	584	600	584
Total cold run time: 71921 ms
Total hot run time: 59179 ms

doris-robot · 2024-12-19T04:42:10Z

TPC-DS: Total hot run time: 190421 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f1d448401189e6fec15a56def24610f39d2edf42, data reload: false

query1	964	375	375	375
query2	6524	2357	2365	2357
query3	6717	216	218	216
query4	34355	23490	23356	23356
query5	4407	467	449	449
query6	293	193	218	193
query7	4635	303	313	303
query8	327	244	248	244
query9	9805	2723	2708	2708
query10	484	257	237	237
query11	18022	15361	15183	15183
query12	157	112	109	109
query13	1682	458	405	405
query14	9511	6861	7478	6861
query15	261	171	182	171
query16	8262	396	421	396
query17	1603	570	550	550
query18	2131	297	291	291
query19	342	155	161	155
query20	116	111	111	111
query21	211	113	103	103
query22	4531	4252	4117	4117
query23	34444	33618	33610	33610
query24	11509	2497	2567	2497
query25	716	407	424	407
query26	1880	164	159	159
query27	2980	339	338	338
query28	8208	2451	2419	2419
query29	1080	448	440	440
query30	305	155	159	155
query31	1045	824	796	796
query32	105	61	60	60
query33	804	320	354	320
query34	955	519	524	519
query35	877	770	771	770
query36	1103	955	952	952
query37	284	75	81	75
query38	4325	4026	4079	4026
query39	1484	1501	1429	1429
query40	290	102	105	102
query41	53	47	44	44
query42	113	101	101	101
query43	526	482	484	482
query44	1308	806	813	806
query45	183	168	166	166
query46	1151	696	699	696
query47	1954	1836	1839	1836
query48	393	324	326	324
query49	1282	392	391	391
query50	805	377	388	377
query51	7231	7205	7143	7143
query52	104	90	93	90
query53	255	184	189	184
query54	1145	406	417	406
query55	81	87	77	77
query56	269	247	232	232
query57	1284	1128	1099	1099
query58	235	242	220	220
query59	3159	3148	3013	3013
query60	267	273	252	252
query61	115	107	103	103
query62	909	658	712	658
query63	214	191	198	191
query64	5110	667	683	667
query65	3256	3278	3261	3261
query66	1423	319	319	319
query67	16065	15549	15497	15497
query68	5475	543	529	529
query69	428	245	255	245
query70	1213	1137	1075	1075
query71	443	251	253	251
query72	7048	4102	4112	4102
query73	769	356	364	356
query74	10355	8880	8993	8880
query75	3436	2634	2646	2634
query76	3382	1044	1115	1044
query77	579	284	312	284
query78	10247	9458	9453	9453
query79	2011	597	595	595
query80	808	427	429	427
query81	555	248	238	238
query82	702	119	117	117
query83	163	154	146	146
query84	233	68	71	68
query85	1552	313	303	303
query86	452	296	284	284
query87	4708	4771	4486	4486
query88	4231	2267	2171	2171
query89	413	293	304	293
query90	2108	196	185	185
query91	140	105	112	105
query92	68	52	54	52
query93	1698	542	542	542
query94	947	284	278	278
query95	355	254	254	254
query96	613	276	281	276
query97	2834	2685	2631	2631
query98	227	202	203	202
query99	1673	1321	1316	1316
Total cold run time: 306490 ms
Total hot run time: 190421 ms

doris-robot · 2024-12-19T04:47:41Z

ClickBench: Total hot run time: 32 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f1d448401189e6fec15a56def24610f39d2edf42, data reload: false

query1	0.03	0.03	0.03
query2	0.08	0.04	0.04
query3	0.23	0.07	0.07
query4	1.62	0.10	0.10
query5	0.42	0.40	0.39
query6	1.14	0.64	0.64
query7	0.02	0.01	0.01
query8	0.04	0.03	0.04
query9	0.58	0.50	0.49
query10	0.55	0.57	0.53
query11	0.14	0.11	0.10
query12	0.13	0.11	0.11
query13	0.61	0.61	0.61
query14	2.74	2.79	2.87
query15	0.91	0.83	0.82
query16	0.39	0.39	0.37
query17	1.04	1.05	1.06
query18	0.22	0.21	0.21
query19	1.99	1.83	2.03
query20	0.01	0.01	0.01
query21	15.38	0.60	0.59
query22	2.73	2.69	1.79
query23	17.18	0.91	0.75
query24	3.32	1.32	0.28
query25	0.26	0.06	0.05
query26	0.43	0.12	0.13
query27	0.04	0.07	0.05
query28	11.01	1.12	1.07
query29	12.58	3.26	3.24
query30	0.25	0.08	0.07
query31	2.82	0.40	0.39
query32	3.24	0.47	0.46
query33	3.18	3.25	3.21
query34	16.88	4.43	4.48
query35	4.48	4.47	4.48
query36	0.67	0.50	0.49
query37	0.10	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.03
query40	0.16	0.12	0.13
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.04
Total cold run time: 107.84 s
Total hot run time: 32 s

feiniaofeiafei · 2024-12-19T05:15:04Z

run p0

github-actions · 2024-12-20T10:35:52Z

PR approved by at least one committer and no changes requested.

924060929 · 2024-12-21T09:53:40Z

regression-test/suites/nereids_rules_p0/partition_prune/test_convert_tz.groovy

@@ -93,7 +93,7 @@ suite("test_convert_tz") {
        }
        explain {
            sql "SELECT * FROM test_convert_tz WHERE not convert_tz(timestamp, 'Asia/Shanghai', 'Europe/Paris') <= '2021-01-01';";
-            contains("partitions=2/3 (p2,p3)")
+            contains("partitions=3/3 (p1,p2,p3)")


this test has rollback, we should improve it later

morrySnow reviewed Dec 5, 2024

View reviewed changes

feiniaofeiafei force-pushed the prune_add_diff_sub branch from c1871b2 to e14e305 Compare December 17, 2024 13:16

feiniaofeiafei added 8 commits December 18, 2024 22:06

add xx_add xx_diff xx_sub

44d763d

add xx_floor xx_ceil and test

8789c4f

modify regression table name

bf5996f

If the computed newRange is from positive infinity to negative infini…

ea24c9e

…ty, then directly return result.

add lower and upper for isMonotonic

dfc2426

modify by comment

3002086

add regression cases

41c026b

add regression case for unix_timestamp and from_days

46df61a

morrySnow previously approved these changes Dec 18, 2024

View reviewed changes

github-actions bot added the approved Indicates a PR has been approved by one committer. label Dec 18, 2024

github-actions bot added the reviewed label Dec 18, 2024

add cases

d0f566b

feiniaofeiafei dismissed morrySnow’s stale review via d0f566b December 19, 2024 02:53

feiniaofeiafei force-pushed the prune_add_diff_sub branch from e14e305 to d0f566b Compare December 19, 2024 02:53

github-actions bot removed the approved Indicates a PR has been approved by one committer. label Dec 19, 2024

fix ut

f1d4484

morrySnow approved these changes Dec 20, 2024

View reviewed changes

morrySnow closed this Dec 20, 2024

morrySnow reopened this Dec 20, 2024

924060929 approved these changes Dec 20, 2024

View reviewed changes

github-actions bot added the approved Indicates a PR has been approved by one committer. label Dec 20, 2024

924060929 reviewed Dec 21, 2024

View reviewed changes

924060929 changed the title ~~[enhance](nereids) add, sub, diff, floor, ceil date function implement Monotonic~~ [enhance](nereids) date_add, date_sub, date_diff, date_floor, date_ceil function implement Monotonic Dec 21, 2024

924060929 approved these changes Dec 21, 2024

View reviewed changes

924060929 merged commit f6071a3 into apache:master Dec 21, 2024
34 of 36 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[enhance](nereids) date_add, date_sub, date_diff, date_floor, date_ceil function implement Monotonic #44943

[enhance](nereids) date_add, date_sub, date_diff, date_floor, date_ceil function implement Monotonic #44943

feiniaofeiafei commented Dec 3, 2024 •

edited by 924060929

Loading

doris-robot commented Dec 3, 2024

feiniaofeiafei commented Dec 3, 2024

doris-robot commented Dec 3, 2024

doris-robot commented Dec 3, 2024

doris-robot commented Dec 3, 2024

feiniaofeiafei commented Dec 4, 2024

doris-robot commented Dec 4, 2024

doris-robot commented Dec 4, 2024

doris-robot commented Dec 4, 2024

morrySnow Dec 5, 2024

github-actions bot commented Dec 18, 2024

github-actions bot commented Dec 18, 2024

feiniaofeiafei commented Dec 19, 2024

doris-robot commented Dec 19, 2024

doris-robot commented Dec 19, 2024

doris-robot commented Dec 19, 2024

feiniaofeiafei commented Dec 19, 2024

doris-robot commented Dec 19, 2024

doris-robot commented Dec 19, 2024

doris-robot commented Dec 19, 2024

feiniaofeiafei commented Dec 19, 2024

github-actions bot commented Dec 20, 2024

924060929 Dec 21, 2024

[enhance](nereids) date_add, date_sub, date_diff, date_floor, date_ceil function implement Monotonic #44943

[enhance](nereids) date_add, date_sub, date_diff, date_floor, date_ceil function implement Monotonic #44943

Conversation

feiniaofeiafei commented Dec 3, 2024 • edited by 924060929 Loading

What problem does this PR solve?

Check List (For Author)

Check List (For Reviewer who merge this PR)

doris-robot commented Dec 3, 2024

feiniaofeiafei commented Dec 3, 2024

doris-robot commented Dec 3, 2024

doris-robot commented Dec 3, 2024

doris-robot commented Dec 3, 2024

feiniaofeiafei commented Dec 4, 2024

doris-robot commented Dec 4, 2024

doris-robot commented Dec 4, 2024

doris-robot commented Dec 4, 2024

morrySnow Dec 5, 2024

Choose a reason for hiding this comment

github-actions bot commented Dec 18, 2024

github-actions bot commented Dec 18, 2024

feiniaofeiafei commented Dec 19, 2024

doris-robot commented Dec 19, 2024

doris-robot commented Dec 19, 2024

doris-robot commented Dec 19, 2024

feiniaofeiafei commented Dec 19, 2024

doris-robot commented Dec 19, 2024

doris-robot commented Dec 19, 2024

doris-robot commented Dec 19, 2024

feiniaofeiafei commented Dec 19, 2024

github-actions bot commented Dec 20, 2024

924060929 Dec 21, 2024

Choose a reason for hiding this comment

feiniaofeiafei commented Dec 3, 2024 •

edited by 924060929

Loading