Skip to content

[Enhancement] (nereids) implement cancelDecommissionBackend in nereids #50671

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 36 commits into from
Jun 6, 2025
Merged

[Enhancement] (nereids) implement cancelDecommissionBackend in nereids #50671

merged 36 commits into from
Jun 6, 2025

Conversation

yx-keith
Copy link
Contributor

@yx-keith yx-keith commented May 7, 2025

What problem does this PR solve?

Issue Number: #42561

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented May 7, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@yx-keith
Copy link
Contributor Author

run buildall

@yx-keith
Copy link
Contributor Author

run buildall

@yx-keith
Copy link
Contributor Author

run buildall

@yx-keith
Copy link
Contributor Author

run buildall

@yx-keith
Copy link
Contributor Author

run buildall

@yx-keith
Copy link
Contributor Author

run buildall

@yx-keith
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33794 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 97988dc372147716afd7c339df36b9b0a68b9023, data reload: false

------ Round 1 ----------------------------------
q1	26550	5154	5056	5056
q2	2084	289	190	190
q3	10416	1319	698	698
q4	10234	1015	539	539
q5	7617	2411	2307	2307
q6	181	163	130	130
q7	929	743	596	596
q8	9346	1294	1000	1000
q9	6910	5143	5050	5050
q10	6868	2345	1894	1894
q11	496	293	269	269
q12	353	348	216	216
q13	17769	3693	3116	3116
q14	223	224	210	210
q15	543	496	498	496
q16	439	433	381	381
q17	626	874	364	364
q18	7743	7166	7216	7166
q19	1371	957	552	552
q20	335	340	231	231
q21	3983	3204	2368	2368
q22	1054	1003	965	965
Total cold run time: 116070 ms
Total hot run time: 33794 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5193	5116	5114	5114
q2	245	334	242	242
q3	2204	2667	2315	2315
q4	1394	1792	1422	1422
q5	4520	4454	4391	4391
q6	214	175	131	131
q7	2033	1927	1771	1771
q8	2584	2596	2524	2524
q9	7136	7228	7046	7046
q10	3053	3208	2725	2725
q11	596	517	520	517
q12	687	795	607	607
q13	3529	3920	3321	3321
q14	271	283	276	276
q15	508	473	469	469
q16	445	482	474	474
q17	1176	1607	1344	1344
q18	7700	7556	7423	7423
q19	834	943	1073	943
q20	1969	2035	1830	1830
q21	4728	4285	4366	4285
q22	1065	1041	1011	1011
Total cold run time: 52084 ms
Total hot run time: 50181 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 185655 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 97988dc372147716afd7c339df36b9b0a68b9023, data reload: false

query1	1009	490	497	490
query2	6558	1823	1826	1823
query3	6748	225	223	223
query4	26213	23226	22822	22822
query5	4297	614	446	446
query6	299	204	204	204
query7	4615	499	283	283
query8	283	248	236	236
query9	8621	2653	2639	2639
query10	498	355	272	272
query11	15489	15083	14823	14823
query12	149	110	103	103
query13	1656	515	402	402
query14	8785	5939	6179	5939
query15	219	181	171	171
query16	7118	642	492	492
query17	917	709	567	567
query18	1967	392	295	295
query19	186	195	158	158
query20	115	112	124	112
query21	214	122	109	109
query22	4129	4446	4039	4039
query23	33889	33116	33198	33116
query24	8450	2353	2375	2353
query25	546	446	390	390
query26	1247	269	158	158
query27	2751	500	334	334
query28	4330	2136	2127	2127
query29	769	552	420	420
query30	285	214	184	184
query31	931	856	748	748
query32	76	65	65	65
query33	573	379	314	314
query34	802	872	512	512
query35	808	820	723	723
query36	988	1010	912	912
query37	121	107	86	86
query38	4115	4132	4071	4071
query39	1512	1437	1412	1412
query40	219	137	117	117
query41	62	59	61	59
query42	126	111	111	111
query43	519	518	476	476
query44	1333	822	821	821
query45	184	176	171	171
query46	861	1032	649	649
query47	1754	1817	1701	1701
query48	394	427	333	333
query49	804	544	435	435
query50	647	680	411	411
query51	4198	4152	4183	4152
query52	118	116	104	104
query53	231	251	190	190
query54	621	581	535	535
query55	90	86	85	85
query56	336	350	295	295
query57	1175	1129	1093	1093
query58	275	263	260	260
query59	2505	2704	2588	2588
query60	343	313	294	294
query61	126	123	124	123
query62	809	736	679	679
query63	222	196	190	190
query64	4359	1002	732	732
query65	4322	4245	4257	4245
query66	1145	413	315	315
query67	15923	15831	15478	15478
query68	8654	914	525	525
query69	475	298	305	298
query70	1168	1113	1084	1084
query71	457	337	288	288
query72	5808	4776	4883	4776
query73	736	654	344	344
query74	8870	9157	8994	8994
query75	3970	3198	2690	2690
query76	3598	1182	759	759
query77	786	356	285	285
query78	10172	10250	9367	9367
query79	2064	820	577	577
query80	649	513	435	435
query81	498	260	223	223
query82	480	125	97	97
query83	257	246	232	232
query84	310	105	90	90
query85	813	355	371	355
query86	391	315	284	284
query87	4394	4425	4279	4279
query88	3534	2262	2259	2259
query89	397	315	289	289
query90	1874	209	206	206
query91	140	141	116	116
query92	76	61	58	58
query93	1623	956	587	587
query94	654	399	293	293
query95	383	294	293	293
query96	502	567	282	282
query97	2736	2796	2625	2625
query98	229	218	209	209
query99	1331	1402	1241	1241
Total cold run time: 274008 ms
Total hot run time: 185655 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.19 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 97988dc372147716afd7c339df36b9b0a68b9023, data reload: false

query1	0.04	0.04	0.03
query2	0.13	0.11	0.11
query3	0.24	0.20	0.20
query4	1.60	0.19	0.11
query5	0.44	0.42	0.42
query6	1.18	0.66	0.65
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.58	0.53	0.53
query10	0.57	0.58	0.56
query11	0.16	0.11	0.11
query12	0.15	0.12	0.12
query13	0.62	0.61	0.60
query14	0.80	0.81	0.80
query15	0.89	0.85	0.89
query16	0.38	0.37	0.38
query17	1.09	1.08	1.05
query18	0.22	0.20	0.21
query19	1.91	1.87	1.88
query20	0.02	0.01	0.01
query21	15.40	0.88	0.56
query22	0.77	1.22	0.66
query23	14.88	1.36	0.62
query24	7.01	2.04	0.99
query25	0.51	0.22	0.05
query26	0.50	0.15	0.15
query27	0.06	0.06	0.06
query28	10.07	0.87	0.46
query29	12.54	4.02	3.28
query30	0.27	0.08	0.06
query31	2.82	0.59	0.39
query32	3.23	0.55	0.46
query33	3.00	3.04	3.10
query34	15.81	5.05	4.46
query35	4.52	4.50	4.52
query36	0.66	0.49	0.48
query37	0.09	0.07	0.07
query38	0.05	0.05	0.04
query39	0.02	0.02	0.03
query40	0.17	0.13	0.12
query41	0.08	0.03	0.03
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 103.61 s
Total hot run time: 29.19 s

@yx-keith
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34057 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5184490a74847f4fad6763ab54508cb3a2b51826, data reload: false

------ Round 1 ----------------------------------
q1	26076	5076	5000	5000
q2	2058	270	177	177
q3	10418	1248	724	724
q4	10220	1000	511	511
q5	7544	2363	2352	2352
q6	176	160	134	134
q7	930	818	627	627
q8	9320	1302	1222	1222
q9	6892	5045	5135	5045
q10	6872	2310	1915	1915
q11	484	316	278	278
q12	354	362	222	222
q13	17825	3853	3178	3178
q14	244	245	217	217
q15	536	480	493	480
q16	440	447	400	400
q17	643	858	362	362
q18	7816	7247	7109	7109
q19	1970	972	560	560
q20	330	325	218	218
q21	3933	3307	2376	2376
q22	1036	1022	950	950
Total cold run time: 116117 ms
Total hot run time: 34057 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5186	5101	5072	5072
q2	234	322	240	240
q3	2172	2616	2279	2279
q4	1359	1755	1400	1400
q5	4455	4395	4406	4395
q6	222	168	127	127
q7	1980	1994	1822	1822
q8	2624	2501	2562	2501
q9	7219	7173	7034	7034
q10	2984	3194	2723	2723
q11	587	514	497	497
q12	666	776	613	613
q13	3533	3881	3307	3307
q14	287	315	316	315
q15	532	479	468	468
q16	464	483	461	461
q17	1162	1530	1405	1405
q18	7755	7559	7378	7378
q19	881	851	969	851
q20	2013	1980	1858	1858
q21	4887	4515	4437	4437
q22	1110	1057	1070	1057
Total cold run time: 52312 ms
Total hot run time: 50240 ms

@yx-keith
Copy link
Contributor Author

yx-keith commented Jun 4, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33919 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b91b7ac93bf3c6ff271fd143f03b8b3ade79f849, data reload: false

------ Round 1 ----------------------------------
q1	26483	5052	5112	5052
q2	1948	276	184	184
q3	10295	1205	710	710
q4	10224	998	515	515
q5	7543	2389	2308	2308
q6	178	164	137	137
q7	901	762	596	596
q8	9306	1283	1050	1050
q9	6836	5089	5160	5089
q10	6867	2321	1898	1898
q11	478	284	268	268
q12	353	350	211	211
q13	17803	3695	3044	3044
q14	240	236	220	220
q15	554	484	494	484
q16	423	432	369	369
q17	590	857	366	366
q18	7915	7330	7237	7237
q19	1600	970	580	580
q20	352	359	233	233
q21	4091	3254	2383	2383
q22	1087	1042	985	985
Total cold run time: 116067 ms
Total hot run time: 33919 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5167	5044	5061	5044
q2	236	316	221	221
q3	2135	2651	2257	2257
q4	1324	1819	1396	1396
q5	4447	4387	4376	4376
q6	220	168	129	129
q7	1997	1940	1784	1784
q8	2580	2604	2559	2559
q9	7240	7229	7106	7106
q10	3013	3173	2772	2772
q11	588	515	495	495
q12	667	782	620	620
q13	3505	3869	3363	3363
q14	300	296	268	268
q15	517	477	469	469
q16	453	492	455	455
q17	1163	1541	1403	1403
q18	7741	7543	7611	7543
q19	830	837	1045	837
q20	1961	1981	1837	1837
q21	4826	4462	4386	4386
q22	1121	1020	1054	1020
Total cold run time: 52031 ms
Total hot run time: 50340 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192482 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b91b7ac93bf3c6ff271fd143f03b8b3ade79f849, data reload: false

query1	1427	1119	1066	1066
query2	6317	1833	1865	1833
query3	11121	4595	4726	4595
query4	25642	23812	22957	22957
query5	4952	620	450	450
query6	327	216	227	216
query7	3994	503	287	287
query8	282	238	215	215
query9	8498	2621	2631	2621
query10	515	333	266	266
query11	15398	15341	14820	14820
query12	171	109	109	109
query13	1569	541	396	396
query14	9718	6286	6266	6266
query15	209	187	166	166
query16	7633	653	494	494
query17	1283	752	602	602
query18	2106	401	303	303
query19	200	207	167	167
query20	128	124	119	119
query21	209	130	110	110
query22	4436	4508	4301	4301
query23	34533	33854	33732	33732
query24	8418	2454	2424	2424
query25	513	468	404	404
query26	745	292	159	159
query27	2672	538	348	348
query28	4739	2177	2133	2133
query29	637	592	473	473
query30	278	223	198	198
query31	922	882	790	790
query32	74	68	65	65
query33	548	373	301	301
query34	803	875	546	546
query35	777	824	795	795
query36	964	1007	877	877
query37	116	108	82	82
query38	4222	4339	4288	4288
query39	1550	1501	1445	1445
query40	222	122	109	109
query41	62	59	57	57
query42	119	108	112	108
query43	519	507	481	481
query44	1363	826	825	825
query45	192	183	171	171
query46	908	1066	659	659
query47	1822	1898	1812	1812
query48	431	458	318	318
query49	679	496	388	388
query50	710	717	415	415
query51	4282	4258	4175	4175
query52	119	114	102	102
query53	222	253	182	182
query54	590	587	521	521
query55	87	86	88	86
query56	332	323	297	297
query57	1172	1191	1122	1122
query58	282	263	256	256
query59	2717	2868	2736	2736
query60	338	330	330	330
query61	151	154	182	154
query62	780	746	689	689
query63	237	200	181	181
query64	3116	1098	732	732
query65	4331	4284	4219	4219
query66	786	416	304	304
query67	15945	15674	15576	15576
query68	8761	920	523	523
query69	499	302	272	272
query70	1204	1074	1096	1074
query71	474	312	299	299
query72	5828	4658	4671	4658
query73	690	564	354	354
query74	8957	9145	8644	8644
query75	3983	3185	2666	2666
query76	3735	1206	748	748
query77	795	379	295	295
query78	10102	10192	9407	9407
query79	2714	796	590	590
query80	679	517	437	437
query81	492	256	221	221
query82	440	127	96	96
query83	288	258	237	237
query84	297	108	86	86
query85	779	359	318	318
query86	355	316	272	272
query87	4440	4448	4283	4283
query88	3429	2255	2242	2242
query89	428	327	279	279
query90	1975	211	214	211
query91	148	146	118	118
query92	76	59	58	58
query93	2007	969	583	583
query94	678	409	306	306
query95	382	294	296	294
query96	504	568	286	286
query97	2792	2786	2681	2681
query98	231	213	209	209
query99	1450	1410	1311	1311
Total cold run time: 280772 ms
Total hot run time: 192482 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.62 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b91b7ac93bf3c6ff271fd143f03b8b3ade79f849, data reload: false

query1	0.04	0.04	0.03
query2	0.12	0.11	0.11
query3	0.25	0.20	0.20
query4	1.60	0.20	0.20
query5	0.47	0.44	0.46
query6	1.18	0.66	0.66
query7	0.02	0.02	0.01
query8	0.05	0.03	0.04
query9	0.59	0.52	0.52
query10	0.57	0.57	0.58
query11	0.15	0.11	0.12
query12	0.14	0.12	0.11
query13	0.63	0.61	0.60
query14	0.80	0.82	0.82
query15	0.88	0.88	0.87
query16	0.39	0.38	0.39
query17	1.02	1.06	1.04
query18	0.22	0.21	0.21
query19	1.89	1.85	1.90
query20	0.02	0.01	0.02
query21	15.40	0.91	0.53
query22	0.75	1.30	0.63
query23	14.89	1.38	0.62
query24	6.84	1.06	1.05
query25	0.52	0.12	0.10
query26	0.59	0.16	0.15
query27	0.06	0.04	0.05
query28	9.28	0.93	0.45
query29	12.53	4.01	3.40
query30	0.26	0.09	0.06
query31	2.82	0.60	0.40
query32	3.23	0.54	0.46
query33	3.05	3.08	3.14
query34	15.89	5.21	4.54
query35	4.55	4.54	4.57
query36	0.68	0.50	0.48
query37	0.09	0.07	0.07
query38	0.05	0.04	0.03
query39	0.04	0.02	0.02
query40	0.16	0.14	0.13
query41	0.08	0.04	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 102.86 s
Total hot run time: 29.62 s

@yx-keith yx-keith requested a review from starocean999 June 4, 2025 07:47
starocean999
starocean999 previously approved these changes Jun 4, 2025
View reviewed changes
@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jun 4, 2025
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Jun 4, 2025

PR approved by at least one committer and no changes requested.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Jun 4, 2025

PR approved by anyone and no changes requested.

englefly
englefly previously approved these changes Jun 5, 2025
View reviewed changes
@yx-keith yx-keith dismissed stale reviews from englefly and starocean999 via 4fc3f47 June 5, 2025 08:49
@github-actions github-actions bot removed the approved Indicates a PR has been approved by one committer. label Jun 5, 2025
@yx-keith
Copy link
Contributor Author

yx-keith commented Jun 5, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33647 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4fc3f473d85c12ab58d22b28ebc26d47cf6840aa, data reload: false

------ Round 1 ----------------------------------
q1	26347	6086	5068	5068
q2	2005	285	184	184
q3	10279	1224	708	708
q4	10235	981	523	523
q5	7510	2299	2375	2299
q6	178	173	132	132
q7	865	759	596	596
q8	9299	1274	1090	1090
q9	6785	5064	5100	5064
q10	6861	2320	1877	1877
q11	507	284	275	275
q12	343	351	209	209
q13	17789	3641	3047	3047
q14	231	239	221	221
q15	546	478	494	478
q16	422	436	365	365
q17	595	848	361	361
q18	7698	7173	7250	7173
q19	1229	936	524	524
q20	332	332	214	214
q21	3770	2520	2285	2285
q22	1051	1036	954	954
Total cold run time: 114877 ms
Total hot run time: 33647 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5031	5046	5057	5046
q2	238	318	222	222
q3	2158	2636	2299	2299
q4	1355	1811	1423	1423
q5	4538	4423	4423	4423
q6	206	170	125	125
q7	1918	1894	1748	1748
q8	2538	2668	2479	2479
q9	7054	7079	7062	7062
q10	3024	3198	2693	2693
q11	580	503	498	498
q12	686	775	617	617
q13	3422	3882	3260	3260
q14	275	284	284	284
q15	543	474	486	474
q16	433	470	447	447
q17	1163	1602	1319	1319
q18	7837	7498	7444	7444
q19	776	824	928	824
q20	1971	2042	1883	1883
q21	4937	4312	4272	4272
q22	1043	1032	987	987
Total cold run time: 51726 ms
Total hot run time: 49829 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 185644 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4fc3f473d85c12ab58d22b28ebc26d47cf6840aa, data reload: false

query1	1010	477	492	477
query2	6604	1817	1761	1761
query3	6769	227	219	219
query4	25918	24310	23632	23632
query5	4361	638	449	449
query6	301	203	181	181
query7	4630	483	282	282
query8	256	214	216	214
query9	8631	2623	2650	2623
query10	483	337	277	277
query11	15700	15046	14791	14791
query12	161	109	107	107
query13	1660	528	409	409
query14	9236	6052	6090	6052
query15	203	214	172	172
query16	7216	646	437	437
query17	1202	731	573	573
query18	1977	408	307	307
query19	195	190	162	162
query20	129	121	121	121
query21	218	126	109	109
query22	4171	4358	4074	4074
query23	34115	33028	33058	33028
query24	8473	2355	2407	2355
query25	533	452	393	393
query26	1230	263	149	149
query27	2767	510	353	353
query28	4299	2130	2128	2128
query29	771	541	430	430
query30	288	216	185	185
query31	939	842	782	782
query32	71	60	64	60
query33	566	360	300	300
query34	798	838	510	510
query35	772	812	691	691
query36	933	1003	879	879
query37	115	97	77	77
query38	4177	4109	4039	4039
query39	1488	1430	1399	1399
query40	204	117	104	104
query41	67	60	58	58
query42	136	117	108	108
query43	515	475	471	471
query44	1297	869	842	842
query45	181	174	174	174
query46	830	1027	625	625
query47	1777	1805	1758	1758
query48	381	417	306	306
query49	739	500	387	387
query50	651	682	390	390
query51	4107	4146	4035	4035
query52	109	107	93	93
query53	219	250	178	178
query54	579	564	493	493
query55	88	80	81	80
query56	299	303	283	283
query57	1141	1128	1078	1078
query58	264	250	255	250
query59	2587	2643	2641	2641
query60	347	319	298	298
query61	126	126	127	126
query62	807	718	661	661
query63	218	194	186	186
query64	4421	1012	677	677
query65	4214	4167	4159	4159
query66	1169	414	307	307
query67	15818	15565	15422	15422
query68	8588	880	522	522
query69	468	307	320	307
query70	1130	1105	1046	1046
query71	470	313	296	296
query72	5503	4764	4671	4671
query73	732	610	354	354
query74	9249	9102	8875	8875
query75	4051	3214	2696	2696
query76	3743	1167	759	759
query77	781	383	277	277
query78	10000	10186	9370	9370
query79	1523	820	598	598
query80	612	518	506	506
query81	474	258	218	218
query82	187	123	98	98
query83	289	249	224	224
query84	298	116	98	98
query85	738	373	317	317
query86	337	304	296	296
query87	4352	4484	4306	4306
query88	2823	2269	2264	2264
query89	368	318	277	277
query90	2071	205	202	202
query91	141	145	112	112
query92	76	62	67	62
query93	1077	967	585	585
query94	681	407	297	297
query95	368	290	285	285
query96	489	559	286	286
query97	2713	2747	2606	2606
query98	220	217	212	212
query99	1460	1424	1245	1245
Total cold run time: 272669 ms
Total hot run time: 185644 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.99 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4fc3f473d85c12ab58d22b28ebc26d47cf6840aa, data reload: false

query1	0.03	0.04	0.02
query2	0.13	0.11	0.11
query3	0.26	0.19	0.19
query4	1.59	0.20	0.18
query5	0.43	0.42	0.42
query6	1.19	0.66	0.66
query7	0.03	0.02	0.01
query8	0.05	0.03	0.04
query9	0.59	0.52	0.50
query10	0.56	0.58	0.57
query11	0.16	0.11	0.11
query12	0.14	0.12	0.12
query13	0.62	0.60	0.60
query14	0.78	0.81	0.81
query15	0.88	0.85	0.87
query16	0.38	0.39	0.39
query17	1.01	1.03	1.03
query18	0.23	0.21	0.20
query19	1.92	1.78	1.84
query20	0.01	0.01	0.01
query21	15.40	0.93	0.54
query22	0.77	1.12	0.58
query23	15.07	1.38	0.63
query24	6.62	2.01	0.77
query25	0.50	0.20	0.12
query26	0.57	0.15	0.14
query27	0.05	0.04	0.05
query28	9.80	0.90	0.45
query29	12.53	3.97	3.34
query30	0.26	0.09	0.06
query31	2.82	0.63	0.38
query32	3.22	0.56	0.47
query33	3.02	3.11	3.16
query34	15.84	5.15	4.49
query35	4.50	4.51	4.49
query36	0.67	0.50	0.49
query37	0.09	0.06	0.06
query38	0.05	0.03	0.03
query39	0.03	0.02	0.03
query40	0.18	0.14	0.13
query41	0.08	0.02	0.03
query42	0.04	0.03	0.02
query43	0.04	0.02	0.03
Total cold run time: 103.14 s
Total hot run time: 28.99 s

@yx-keith
Copy link
Contributor Author

yx-keith commented Jun 5, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33757 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4d24473ed81bd252671e8d82e055020e26d53fda, data reload: false

------ Round 1 ----------------------------------
q1	26170	5092	5020	5020
q2	1963	267	175	175
q3	10445	1211	687	687
q4	10249	1005	548	548
q5	7757	2317	2346	2317
q6	179	165	133	133
q7	907	720	632	632
q8	9342	1289	1091	1091
q9	6676	5052	4981	4981
q10	6868	2292	1912	1912
q11	478	300	271	271
q12	346	354	210	210
q13	17765	3649	3099	3099
q14	236	227	214	214
q15	565	471	489	471
q16	439	430	374	374
q17	589	864	356	356
q18	7593	7279	7166	7166
q19	1779	968	588	588
q20	338	336	226	226
q21	3658	2601	2320	2320
q22	1037	1016	966	966
Total cold run time: 115379 ms
Total hot run time: 33757 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5161	5090	5055	5055
q2	241	314	212	212
q3	2181	2662	2336	2336
q4	1350	1785	1389	1389
q5	4428	4394	4390	4390
q6	230	182	139	139
q7	2033	1930	1779	1779
q8	2565	2549	2510	2510
q9	7134	7158	6838	6838
q10	3041	3228	2783	2783
q11	578	519	481	481
q12	689	796	609	609
q13	3453	3888	3298	3298
q14	284	320	273	273
q15	533	484	478	478
q16	469	493	443	443
q17	1135	1516	1399	1399
q18	7899	7514	7481	7481
q19	813	823	916	823
q20	1974	2055	1823	1823
q21	4703	4574	4501	4501
q22	1085	1072	1027	1027
Total cold run time: 51979 ms
Total hot run time: 50067 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191872 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4d24473ed81bd252671e8d82e055020e26d53fda, data reload: false

query1	1364	1083	1073	1073
query2	6256	1782	1818	1782
query3	11027	4436	4427	4427
query4	53331	24853	22971	22971
query5	5238	588	455	455
query6	335	208	192	192
query7	4898	506	279	279
query8	271	225	207	207
query9	5558	2697	2686	2686
query10	460	371	269	269
query11	15087	15015	14898	14898
query12	177	112	118	112
query13	1049	542	417	417
query14	10091	6342	6473	6342
query15	240	210	178	178
query16	7161	651	476	476
query17	1140	748	595	595
query18	1701	436	332	332
query19	211	198	173	173
query20	136	124	125	124
query21	212	129	109	109
query22	4370	4393	4260	4260
query23	34127	33801	33412	33412
query24	6783	2464	2419	2419
query25	457	473	425	425
query26	708	267	158	158
query27	2287	536	343	343
query28	2986	2217	2219	2217
query29	572	591	436	436
query30	285	229	210	210
query31	870	865	789	789
query32	72	67	64	64
query33	443	359	326	326
query34	798	866	535	535
query35	775	838	762	762
query36	970	1004	932	932
query37	116	109	85	85
query38	4301	4340	4238	4238
query39	1517	1501	1559	1501
query40	207	124	106	106
query41	60	62	55	55
query42	132	115	113	113
query43	511	520	501	501
query44	1324	840	843	840
query45	175	183	171	171
query46	882	1036	661	661
query47	1905	1900	1771	1771
query48	412	434	335	335
query49	658	473	422	422
query50	664	721	418	418
query51	4163	4346	4179	4179
query52	121	116	107	107
query53	234	260	184	184
query54	591	603	513	513
query55	87	90	92	90
query56	304	297	283	283
query57	1178	1220	1144	1144
query58	275	284	269	269
query59	2655	2796	2687	2687
query60	355	339	320	320
query61	134	124	133	124
query62	741	768	676	676
query63	235	188	187	187
query64	1901	1033	688	688
query65	4242	4192	4135	4135
query66	729	400	300	300
query67	15918	15644	15362	15362
query68	7239	879	536	536
query69	540	309	280	280
query70	1246	1115	1149	1115
query71	510	353	306	306
query72	5525	4735	4735	4735
query73	1484	622	352	352
query74	8866	9371	8620	8620
query75	3963	3197	2677	2677
query76	4289	1191	747	747
query77	680	382	300	300
query78	10081	10110	9301	9301
query79	2399	821	568	568
query80	637	511	450	450
query81	487	255	220	220
query82	429	131	99	99
query83	331	241	236	236
query84	295	118	95	95
query85	799	355	314	314
query86	374	310	298	298
query87	4344	4405	4265	4265
query88	3387	2343	2265	2265
query89	404	315	292	292
query90	1952	203	207	203
query91	143	145	112	112
query92	74	58	56	56
query93	1153	931	584	584
query94	679	416	299	299
query95	369	295	289	289
query96	499	562	278	278
query97	2725	2764	2663	2663
query98	245	203	205	203
query99	1404	1407	1264	1264
Total cold run time: 296725 ms
Total hot run time: 191872 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.01 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4d24473ed81bd252671e8d82e055020e26d53fda, data reload: false

query1	0.04	0.04	0.03
query2	0.12	0.11	0.12
query3	0.25	0.19	0.19
query4	1.60	0.19	0.19
query5	0.46	0.44	0.45
query6	1.18	0.66	0.65
query7	0.02	0.02	0.01
query8	0.04	0.04	0.03
query9	0.58	0.51	0.53
query10	0.57	0.57	0.58
query11	0.15	0.11	0.11
query12	0.15	0.11	0.11
query13	0.61	0.61	0.61
query14	0.80	0.81	0.81
query15	0.88	0.87	0.85
query16	0.38	0.37	0.37
query17	1.04	1.05	1.01
query18	0.23	0.21	0.21
query19	1.93	1.81	1.79
query20	0.01	0.00	0.01
query21	15.51	0.86	0.53
query22	0.76	1.30	0.68
query23	14.81	1.36	0.60
query24	6.77	2.24	0.82
query25	0.50	0.29	0.05
query26	0.59	0.16	0.15
query27	0.05	0.05	0.05
query28	9.55	0.86	0.44
query29	12.77	4.02	3.34
query30	0.25	0.09	0.06
query31	2.84	0.60	0.39
query32	3.23	0.55	0.46
query33	3.00	3.12	3.04
query34	15.76	5.07	4.50
query35	4.48	4.52	4.50
query36	0.68	0.49	0.49
query37	0.08	0.06	0.07
query38	0.05	0.04	0.03
query39	0.03	0.03	0.02
query40	0.16	0.13	0.13
query41	0.08	0.02	0.03
query42	0.04	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 103.07 s
Total hot run time: 29.01 s

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jun 6, 2025
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Jun 6, 2025

PR approved by at least one committer and no changes requested.

@yx-keith yx-keith requested a review from englefly June 6, 2025 01:37
@starocean999 starocean999 merged commit d316548 into apache:master Jun 6, 2025
24 of 26 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@englefly englefly englefly approved these changes

@starocean999 starocean999 starocean999 approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@yx-keith @Thearas @doris-robot @englefly @starocean999