Skip to content

[fix](test) Fix the unstable test #51182

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jun 6, 2025

Conversation

codeDing18
Copy link
Contributor

@codeDing18 codeDing18 commented May 23, 2025

What problem does this PR solve?

Problem Summary:
fix TruncateTableCommandTest and CreateStorageVaultCommandTest occasional ConcurrentModificationException

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@codeDing18
Copy link
Contributor Author

run buildall

@codeDing18
Copy link
Contributor Author

run feut

@doris-robot
Copy link

TPC-H: Total hot run time: 33733 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5930394c8784b72656732d5238e2215a026a22f0, data reload: false

------ Round 1 ----------------------------------
q1	25954	5013	5016	5013
q2	2076	281	179	179
q3	10400	1246	668	668
q4	10211	980	511	511
q5	7538	2331	2359	2331
q6	181	162	133	133
q7	915	754	591	591
q8	9311	1244	1121	1121
q9	6867	5113	5049	5049
q10	6867	2316	1896	1896
q11	488	299	277	277
q12	352	346	217	217
q13	18079	3773	3096	3096
q14	217	229	213	213
q15	537	495	487	487
q16	429	428	376	376
q17	584	827	355	355
q18	7507	7151	7320	7151
q19	1654	936	527	527
q20	334	321	219	219
q21	3630	3171	2340	2340
q22	1057	1009	983	983
Total cold run time: 115188 ms
Total hot run time: 33733 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5171	5066	5448	5066
q2	238	324	224	224
q3	2143	2678	2251	2251
q4	1347	1777	1390	1390
q5	4401	4441	4414	4414
q6	221	163	128	128
q7	1961	1908	1769	1769
q8	2549	2516	2509	2509
q9	7248	7157	6945	6945
q10	3084	3221	2763	2763
q11	583	501	494	494
q12	662	778	614	614
q13	3540	3938	3314	3314
q14	284	320	291	291
q15	542	492	505	492
q16	434	495	445	445
q17	1161	1594	1378	1378
q18	7671	7608	7479	7479
q19	830	776	792	776
q20	2001	2042	1849	1849
q21	4766	4560	4466	4466
q22	1103	1063	1060	1060
Total cold run time: 51940 ms
Total hot run time: 50117 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192479 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5930394c8784b72656732d5238e2215a026a22f0, data reload: false

query1	1409	1097	1062	1062
query2	6199	1809	1826	1809
query3	11172	4660	4811	4660
query4	25613	24165	23028	23028
query5	4979	656	459	459
query6	303	221	205	205
query7	3984	515	290	290
query8	291	262	235	235
query9	8513	2617	2662	2617
query10	515	335	289	289
query11	15562	15081	14710	14710
query12	171	115	106	106
query13	1561	550	427	427
query14	9212	6047	6209	6047
query15	229	196	172	172
query16	7585	680	460	460
query17	1157	786	593	593
query18	2064	450	313	313
query19	209	211	174	174
query20	134	121	122	121
query21	213	138	121	121
query22	4559	4502	4283	4283
query23	34645	33981	33669	33669
query24	8617	2453	2434	2434
query25	522	490	440	440
query26	730	297	153	153
query27	2716	564	353	353
query28	4465	2173	2209	2173
query29	638	596	452	452
query30	274	230	194	194
query31	894	866	767	767
query32	93	69	64	64
query33	548	355	304	304
query34	831	950	544	544
query35	840	854	743	743
query36	991	1019	899	899
query37	120	104	77	77
query38	4167	4342	4229	4229
query39	1539	1493	1471	1471
query40	257	123	115	115
query41	56	53	52	52
query42	128	112	113	112
query43	520	520	475	475
query44	1402	851	850	850
query45	190	184	169	169
query46	929	1082	661	661
query47	1841	1883	1767	1767
query48	414	463	344	344
query49	719	552	443	443
query50	693	743	434	434
query51	4328	4299	4173	4173
query52	118	115	103	103
query53	233	273	206	206
query54	613	604	503	503
query55	88	89	85	85
query56	303	302	319	302
query57	1166	1215	1131	1131
query58	285	274	257	257
query59	2754	2681	2665	2665
query60	337	320	296	296
query61	129	130	121	121
query62	791	766	682	682
query63	245	203	192	192
query64	2973	1074	683	683
query65	4406	4369	4244	4244
query66	780	417	371	371
query67	15790	15508	15479	15479
query68	9558	912	535	535
query69	491	309	268	268
query70	1219	1084	1082	1082
query71	485	351	315	315
query72	5146	4698	4773	4698
query73	729	611	370	370
query74	9187	9056	9005	9005
query75	4346	3229	2712	2712
query76	3793	1319	787	787
query77	1006	388	280	280
query78	10053	10265	9270	9270
query79	1932	878	570	570
query80	656	530	465	465
query81	485	256	232	232
query82	478	129	96	96
query83	267	250	231	231
query84	287	101	87	87
query85	775	362	309	309
query86	319	309	296	296
query87	4475	4477	4320	4320
query88	2970	2291	2279	2279
query89	406	325	288	288
query90	1875	221	213	213
query91	139	143	112	112
query92	77	64	57	57
query93	1140	964	589	589
query94	674	429	318	318
query95	370	289	285	285
query96	495	628	288	288
query97	2756	2782	2610	2610
query98	231	209	208	208
query99	1462	1431	1242	1242
Total cold run time: 279034 ms
Total hot run time: 192479 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.88 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5930394c8784b72656732d5238e2215a026a22f0, data reload: false

query1	0.04	0.04	0.04
query2	0.13	0.10	0.12
query3	0.25	0.20	0.20
query4	1.59	0.20	0.20
query5	0.46	0.46	0.44
query6	1.16	0.69	0.65
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.57	0.51	0.53
query10	0.56	0.57	0.57
query11	0.16	0.11	0.11
query12	0.15	0.12	0.11
query13	0.61	0.59	0.60
query14	0.80	0.81	0.81
query15	0.88	0.88	0.86
query16	0.37	0.39	0.39
query17	1.03	1.03	1.03
query18	0.24	0.21	0.22
query19	1.92	1.79	1.80
query20	0.01	0.01	0.02
query21	15.39	0.88	0.55
query22	0.74	1.08	0.78
query23	14.89	1.39	0.65
query24	7.32	1.51	0.41
query25	0.55	0.14	0.06
query26	0.64	0.18	0.13
query27	0.05	0.04	0.05
query28	8.47	0.95	0.45
query29	12.56	4.07	3.33
query30	0.26	0.09	0.06
query31	2.82	0.61	0.38
query32	3.23	0.56	0.47
query33	3.11	3.05	3.12
query34	15.79	5.16	4.50
query35	4.61	4.55	4.56
query36	0.65	0.49	0.50
query37	0.09	0.06	0.07
query38	0.06	0.05	0.03
query39	0.02	0.02	0.02
query40	0.17	0.13	0.12
query41	0.08	0.03	0.03
query42	0.03	0.02	0.02
query43	0.04	0.04	0.03
Total cold run time: 102.56 s
Total hot run time: 28.88 s

@codeDing18
Copy link
Contributor Author

run feut

4 similar comments
@codeDing18
Copy link
Contributor Author

run feut

@codeDing18
Copy link
Contributor Author

run feut

@codeDing18
Copy link
Contributor Author

run feut

@codeDing18
Copy link
Contributor Author

run feut

@codeDing18 codeDing18 force-pushed the fix-truncatecommand-ut branch from 5930394 to 789d79b Compare June 4, 2025 08:43
@codeDing18
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34675 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 789d79b4e5d4f1b712b02fce0f98c4021cfcb84f, data reload: false

------ Round 1 ----------------------------------
q1	27385	5073	5073	5073
q2	2000	282	204	204
q3	10286	1235	702	702
q4	10230	995	531	531
q5	7539	2379	2320	2320
q6	182	172	139	139
q7	928	737	636	636
q8	9310	1285	1015	1015
q9	6845	5069	5104	5069
q10	6878	2331	1905	1905
q11	479	299	293	293
q12	350	358	226	226
q13	17781	3716	3104	3104
q14	234	235	221	221
q15	560	479	491	479
q16	448	444	383	383
q17	639	870	392	392
q18	7675	7227	7174	7174
q19	1632	1005	558	558
q20	366	374	229	229
q21	4099	3178	3031	3031
q22	1098	1021	991	991
Total cold run time: 116944 ms
Total hot run time: 34675 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5219	5199	5094	5094
q2	238	322	225	225
q3	2226	2684	2345	2345
q4	1383	1860	1436	1436
q5	4460	4425	4427	4425
q6	221	166	129	129
q7	2031	1905	1763	1763
q8	2560	2606	2519	2519
q9	7286	6942	7132	6942
q10	3032	3178	2814	2814
q11	569	529	499	499
q12	694	760	627	627
q13	3498	3903	3390	3390
q14	279	284	266	266
q15	527	469	481	469
q16	454	504	468	468
q17	1174	1534	1406	1406
q18	7737	7663	7620	7620
q19	804	878	941	878
q20	1934	1969	1856	1856
q21	4938	4533	4412	4412
q22	1090	1096	1042	1042
Total cold run time: 52354 ms
Total hot run time: 50625 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 194694 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 789d79b4e5d4f1b712b02fce0f98c4021cfcb84f, data reload: false

query1	1453	1115	1078	1078
query2	6236	1907	1878	1878
query3	10978	4631	4432	4432
query4	54148	25578	23413	23413
query5	5161	549	473	473
query6	343	225	205	205
query7	4877	529	302	302
query8	297	234	219	219
query9	5466	2793	2796	2793
query10	465	336	291	291
query11	14974	15012	14832	14832
query12	168	123	121	121
query13	1050	550	427	427
query14	10148	6409	6478	6409
query15	228	209	180	180
query16	7137	682	477	477
query17	1051	737	572	572
query18	1620	417	317	317
query19	241	195	165	165
query20	138	126	127	126
query21	215	122	107	107
query22	4418	4519	4417	4417
query23	34414	33598	33684	33598
query24	6560	2452	2488	2452
query25	508	481	425	425
query26	717	278	158	158
query27	2311	529	359	359
query28	2999	2331	2306	2306
query29	588	575	459	459
query30	286	231	200	200
query31	898	877	830	830
query32	74	66	63	63
query33	453	387	332	332
query34	844	898	564	564
query35	823	901	764	764
query36	1023	1043	982	982
query37	118	108	80	80
query38	4414	4390	4230	4230
query39	1530	1470	1472	1470
query40	211	126	114	114
query41	61	59	59	59
query42	136	118	143	118
query43	520	519	540	519
query44	1392	898	876	876
query45	183	179	171	171
query46	889	1066	691	691
query47	1886	1874	1830	1830
query48	428	449	351	351
query49	675	512	408	408
query50	715	742	430	430
query51	4288	4255	4187	4187
query52	120	108	103	103
query53	237	272	192	192
query54	619	622	531	531
query55	89	87	93	87
query56	313	296	302	296
query57	1187	1218	1148	1148
query58	281	279	277	277
query59	2815	2936	2835	2835
query60	343	348	323	323
query61	125	125	134	125
query62	750	730	658	658
query63	238	222	197	197
query64	1757	1027	688	688
query65	4269	4181	4131	4131
query66	767	411	309	309
query67	16061	16091	15725	15725
query68	7298	928	557	557
query69	549	325	278	278
query70	1277	1151	1141	1141
query71	517	324	313	313
query72	5975	4791	4974	4791
query73	1500	654	371	371
query74	9258	9159	8885	8885
query75	3868	3206	2705	2705
query76	4173	1219	778	778
query77	678	399	292	292
query78	10103	10165	9312	9312
query79	2162	867	623	623
query80	633	557	457	457
query81	492	259	225	225
query82	440	136	103	103
query83	367	271	254	254
query84	296	121	93	93
query85	867	350	310	310
query86	379	305	290	290
query87	4469	4469	4297	4297
query88	3879	2407	2359	2359
query89	402	322	305	305
query90	1895	220	211	211
query91	150	144	112	112
query92	76	62	56	56
query93	1714	970	599	599
query94	672	427	316	316
query95	373	299	301	299
query96	513	582	289	289
query97	2724	2754	2704	2704
query98	229	208	212	208
query99	1441	1390	1276	1276
Total cold run time: 300096 ms
Total hot run time: 194694 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.06 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 789d79b4e5d4f1b712b02fce0f98c4021cfcb84f, data reload: false

query1	0.04	0.04	0.03
query2	0.13	0.12	0.10
query3	0.26	0.19	0.19
query4	1.60	0.11	0.11
query5	0.42	0.44	0.42
query6	1.22	0.67	0.66
query7	0.02	0.02	0.02
query8	0.04	0.04	0.04
query9	0.59	0.53	0.52
query10	0.58	0.58	0.57
query11	0.16	0.12	0.12
query12	0.15	0.11	0.11
query13	0.61	0.60	0.60
query14	0.80	0.82	0.80
query15	0.91	0.85	0.88
query16	0.38	0.40	0.41
query17	1.05	1.07	1.05
query18	0.23	0.22	0.22
query19	1.98	1.82	1.85
query20	0.01	0.01	0.01
query21	15.42	0.92	0.55
query22	0.78	1.24	0.78
query23	14.73	1.38	0.64
query24	7.33	1.16	0.44
query25	0.51	0.13	0.20
query26	0.66	0.17	0.15
query27	0.06	0.06	0.05
query28	8.79	0.94	0.48
query29	12.54	4.13	3.40
query30	0.25	0.10	0.06
query31	2.82	0.59	0.39
query32	3.23	0.55	0.47
query33	3.06	3.06	3.15
query34	15.77	5.10	4.50
query35	4.55	4.56	4.53
query36	0.67	0.51	0.47
query37	0.09	0.07	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.03
query40	0.18	0.13	0.13
query41	0.09	0.03	0.03
query42	0.04	0.02	0.02
query43	0.04	0.03	0.02
Total cold run time: 102.87 s
Total hot run time: 29.06 s

@codeDing18
Copy link
Contributor Author

run feut

3 similar comments
@codeDing18
Copy link
Contributor Author

run feut

@codeDing18
Copy link
Contributor Author

run feut

@codeDing18
Copy link
Contributor Author

run feut

@codeDing18 codeDing18 force-pushed the fix-truncatecommand-ut branch from 789d79b to 162dfe0 Compare June 5, 2025 02:40
@codeDing18
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33829 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 162dfe0772afcb8c031cccd178fb6c90f5946ae9, data reload: false

------ Round 1 ----------------------------------
q1	26061	5104	5023	5023
q2	1948	281	182	182
q3	10434	1254	701	701
q4	10283	1024	557	557
q5	8636	2356	2401	2356
q6	182	167	132	132
q7	911	758	605	605
q8	9312	1304	1062	1062
q9	6790	5082	5074	5074
q10	6856	2301	1926	1926
q11	488	283	278	278
q12	345	358	228	228
q13	17883	3757	3036	3036
q14	236	225	211	211
q15	569	482	484	482
q16	446	435	374	374
q17	616	860	402	402
q18	7661	7121	7289	7121
q19	2084	974	561	561
q20	329	348	227	227
q21	3783	3177	2326	2326
q22	1050	1038	965	965
Total cold run time: 116903 ms
Total hot run time: 33829 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5184	5079	5092	5079
q2	240	316	225	225
q3	2213	2635	2245	2245
q4	1337	1764	1476	1476
q5	4572	4462	4378	4378
q6	212	172	127	127
q7	2009	1926	1776	1776
q8	2571	2617	2563	2563
q9	7220	7147	7016	7016
q10	2990	3158	2772	2772
q11	571	517	501	501
q12	671	762	638	638
q13	3551	3839	3230	3230
q14	272	290	260	260
q15	529	478	460	460
q16	430	483	454	454
q17	1178	1602	1374	1374
q18	7813	7499	7350	7350
q19	835	861	967	861
q20	2014	1978	1875	1875
q21	4755	4415	4358	4358
q22	1046	985	997	985
Total cold run time: 52213 ms
Total hot run time: 50003 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 185349 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 162dfe0772afcb8c031cccd178fb6c90f5946ae9, data reload: false

query1	1000	495	507	495
query2	6572	1791	1803	1791
query3	6766	230	217	217
query4	26409	23883	23027	23027
query5	4332	632	490	490
query6	305	200	180	180
query7	4628	496	288	288
query8	259	215	206	206
query9	8635	2648	2608	2608
query10	486	353	289	289
query11	15266	15078	14897	14897
query12	155	110	112	110
query13	1655	544	408	408
query14	8713	6279	6272	6272
query15	210	190	173	173
query16	7118	599	496	496
query17	918	687	544	544
query18	1966	393	295	295
query19	186	181	173	173
query20	131	118	124	118
query21	222	123	107	107
query22	4026	4169	4020	4020
query23	34077	32973	33122	32973
query24	8464	2381	2367	2367
query25	519	464	394	394
query26	1232	265	151	151
query27	2759	497	329	329
query28	4347	2148	2114	2114
query29	762	542	432	432
query30	283	210	185	185
query31	923	828	758	758
query32	75	64	63	63
query33	558	376	322	322
query34	796	875	509	509
query35	787	807	719	719
query36	945	966	855	855
query37	116	105	80	80
query38	4044	4230	4045	4045
query39	1482	1413	1412	1412
query40	223	127	112	112
query41	70	65	73	65
query42	132	110	112	110
query43	498	509	465	465
query44	1317	834	825	825
query45	185	182	177	177
query46	838	1014	616	616
query47	1717	1771	1696	1696
query48	394	426	308	308
query49	748	471	406	406
query50	655	703	395	395
query51	4131	4173	4176	4173
query52	110	113	105	105
query53	221	256	190	190
query54	589	599	521	521
query55	88	89	86	86
query56	327	321	307	307
query57	1177	1118	1106	1106
query58	297	285	255	255
query59	2515	2535	2513	2513
query60	327	318	305	305
query61	126	118	123	118
query62	814	721	649	649
query63	226	187	183	183
query64	4330	983	651	651
query65	4249	4124	4190	4124
query66	1132	433	320	320
query67	15854	15603	15337	15337
query68	8353	883	524	524
query69	477	299	271	271
query70	1170	1094	1070	1070
query71	453	315	308	308
query72	5627	4755	4876	4755
query73	727	618	344	344
query74	9155	8831	8995	8831
query75	3913	3209	2659	2659
query76	3637	1186	749	749
query77	802	382	306	306
query78	10082	10158	9414	9414
query79	5809	802	557	557
query80	662	506	437	437
query81	460	264	214	214
query82	718	129	95	95
query83	280	241	229	229
query84	292	108	85	85
query85	768	342	302	302
query86	354	311	302	302
query87	4411	4477	4389	4389
query88	2982	2296	2280	2280
query89	451	309	292	292
query90	1924	210	205	205
query91	144	143	111	111
query92	73	62	62	62
query93	3114	928	565	565
query94	665	408	297	297
query95	374	292	274	274
query96	501	560	278	278
query97	2712	2753	2641	2641
query98	233	217	201	201
query99	1439	1416	1272	1272
Total cold run time: 278179 ms
Total hot run time: 185349 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.69 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 162dfe0772afcb8c031cccd178fb6c90f5946ae9, data reload: false

query1	0.04	0.04	0.03
query2	0.11	0.10	0.11
query3	0.25	0.19	0.20
query4	1.59	0.19	0.11
query5	0.45	0.42	0.43
query6	1.15	0.64	0.65
query7	0.02	0.01	0.02
query8	0.05	0.04	0.03
query9	0.57	0.54	0.52
query10	0.56	0.58	0.57
query11	0.15	0.11	0.11
query12	0.15	0.12	0.12
query13	0.61	0.59	0.60
query14	0.79	0.80	0.81
query15	0.87	0.87	0.86
query16	0.38	0.39	0.38
query17	1.03	1.05	1.02
query18	0.23	0.21	0.21
query19	1.98	1.95	1.82
query20	0.02	0.01	0.01
query21	15.40	0.92	0.56
query22	0.78	1.19	0.74
query23	14.85	1.38	0.58
query24	6.78	2.35	0.51
query25	0.52	0.26	0.07
query26	0.62	0.17	0.15
query27	0.06	0.05	0.04
query28	9.26	0.83	0.44
query29	12.59	4.02	3.35
query30	0.25	0.09	0.07
query31	2.82	0.60	0.39
query32	3.23	0.54	0.47
query33	3.05	3.02	3.06
query34	15.73	5.09	4.49
query35	4.52	4.51	4.47
query36	0.66	0.49	0.48
query37	0.09	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.03
query40	0.17	0.14	0.14
query41	0.07	0.03	0.02
query42	0.03	0.02	0.03
query43	0.04	0.03	0.03
Total cold run time: 102.6 s
Total hot run time: 28.69 s

@codeDing18 codeDing18 force-pushed the fix-truncatecommand-ut branch from 162dfe0 to 82e4a74 Compare June 5, 2025 03:56
@codeDing18
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33829 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 82e4a7486f24a3bdbbdd4dcae0e1e3b0ecd1d367, data reload: false

------ Round 1 ----------------------------------
q1	25871	5030	4988	4988
q2	2183	276	186	186
q3	10558	1231	753	753
q4	10251	996	542	542
q5	7795	2354	2283	2283
q6	176	160	131	131
q7	944	720	593	593
q8	9301	1225	1100	1100
q9	6864	5091	5082	5082
q10	6820	2302	1893	1893
q11	483	289	271	271
q12	343	343	221	221
q13	17769	3695	3103	3103
q14	243	233	214	214
q15	573	500	491	491
q16	415	419	364	364
q17	582	838	356	356
q18	7373	7247	7207	7207
q19	1661	944	559	559
q20	343	326	230	230
q21	4031	2566	2320	2320
q22	1050	1050	942	942
Total cold run time: 115629 ms
Total hot run time: 33829 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5067	5033	5027	5027
q2	235	311	221	221
q3	2121	2671	2235	2235
q4	1352	1766	1387	1387
q5	4390	4361	4379	4361
q6	216	172	130	130
q7	2021	1916	1763	1763
q8	2533	2603	2592	2592
q9	7172	7137	6901	6901
q10	3013	3180	2740	2740
q11	587	515	483	483
q12	675	786	613	613
q13	3536	3836	3207	3207
q14	286	300	273	273
q15	522	491	493	491
q16	449	484	447	447
q17	1126	1523	1350	1350
q18	7640	7484	7416	7416
q19	832	863	1012	863
q20	2039	2055	1942	1942
q21	4711	4483	4425	4425
q22	1105	1095	1039	1039
Total cold run time: 51628 ms
Total hot run time: 49906 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191784 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 82e4a7486f24a3bdbbdd4dcae0e1e3b0ecd1d367, data reload: false

query1	1410	1081	1074	1074
query2	6138	1792	1793	1792
query3	11159	4583	4662	4583
query4	53376	25806	23036	23036
query5	5131	576	447	447
query6	347	203	199	199
query7	4855	504	290	290
query8	281	211	224	211
query9	5286	2639	2630	2630
query10	453	320	274	274
query11	15047	15448	14846	14846
query12	158	104	107	104
query13	1013	518	393	393
query14	10795	6276	6496	6276
query15	205	196	178	178
query16	7114	687	491	491
query17	1053	742	580	580
query18	1550	410	304	304
query19	199	192	163	163
query20	133	130	125	125
query21	199	124	108	108
query22	4292	4411	4195	4195
query23	34269	33683	33547	33547
query24	5819	2372	2407	2372
query25	485	474	402	402
query26	680	297	154	154
query27	1757	497	340	340
query28	2767	2162	2200	2162
query29	562	574	433	433
query30	280	229	196	196
query31	877	874	800	800
query32	70	60	65	60
query33	434	371	306	306
query34	778	860	547	547
query35	772	836	767	767
query36	933	997	895	895
query37	111	107	78	78
query38	4293	4374	4269	4269
query39	1503	1465	1469	1465
query40	227	124	113	113
query41	59	71	57	57
query42	117	105	108	105
query43	496	505	471	471
query44	1313	852	837	837
query45	184	173	168	168
query46	850	1032	646	646
query47	1833	1862	1778	1778
query48	396	457	315	315
query49	641	484	407	407
query50	674	690	411	411
query51	4225	4330	4226	4226
query52	112	108	101	101
query53	236	257	183	183
query54	593	568	518	518
query55	84	87	88	87
query56	312	296	291	291
query57	1180	1210	1124	1124
query58	275	272	270	270
query59	2640	2819	2628	2628
query60	334	333	311	311
query61	126	132	130	130
query62	733	715	662	662
query63	233	185	195	185
query64	1569	1118	793	793
query65	4189	4136	4181	4136
query66	735	407	331	331
query67	15993	15688	15236	15236
query68	6354	841	524	524
query69	551	314	275	275
query70	1199	1137	1060	1060
query71	449	328	369	328
query72	5913	4761	4785	4761
query73	1349	645	344	344
query74	9077	9205	8910	8910
query75	3200	3214	2716	2716
query76	3861	1193	749	749
query77	542	458	279	279
query78	10120	10141	9210	9210
query79	3616	821	574	574
query80	805	506	438	438
query81	493	252	225	225
query82	669	123	97	97
query83	313	247	245	245
query84	337	114	91	91
query85	777	345	307	307
query86	363	278	293	278
query87	4305	4442	4235	4235
query88	3402	2259	2268	2259
query89	416	331	284	284
query90	1657	200	203	200
query91	154	137	114	114
query92	65	64	62	62
query93	2655	926	581	581
query94	733	408	304	304
query95	362	291	287	287
query96	493	587	285	285
query97	2747	2796	2635	2635
query98	232	214	201	201
query99	1433	1411	1314	1314
Total cold run time: 295585 ms
Total hot run time: 191784 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.99 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 82e4a7486f24a3bdbbdd4dcae0e1e3b0ecd1d367, data reload: false

query1	0.04	0.04	0.03
query2	0.12	0.10	0.11
query3	0.25	0.19	0.20
query4	1.60	0.20	0.11
query5	0.43	0.40	0.42
query6	1.18	0.66	0.66
query7	0.02	0.02	0.02
query8	0.05	0.03	0.03
query9	0.58	0.53	0.52
query10	0.56	0.58	0.57
query11	0.15	0.11	0.11
query12	0.14	0.11	0.11
query13	0.61	0.61	0.59
query14	0.78	0.80	0.82
query15	0.88	0.86	0.86
query16	0.39	0.38	0.37
query17	1.05	1.03	1.05
query18	0.22	0.22	0.21
query19	1.91	1.76	1.82
query20	0.01	0.01	0.02
query21	15.40	0.92	0.55
query22	0.75	1.15	0.73
query23	14.93	1.42	0.59
query24	7.36	1.06	0.67
query25	0.48	0.21	0.20
query26	0.71	0.16	0.14
query27	0.05	0.06	0.04
query28	9.40	0.91	0.46
query29	12.54	3.98	3.31
query30	0.25	0.09	0.07
query31	2.82	0.59	0.38
query32	3.22	0.56	0.46
query33	3.02	3.06	3.06
query34	15.80	5.19	4.50
query35	4.50	4.54	4.55
query36	0.66	0.50	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.03
query40	0.16	0.14	0.14
query41	0.08	0.02	0.03
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 103.33 s
Total hot run time: 28.99 s

@codeDing18 codeDing18 force-pushed the fix-truncatecommand-ut branch from 82e4a74 to 0224cca Compare June 5, 2025 05:48
@codeDing18
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33846 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0224cca4f93d6f0e3ea29b1a8e01f793540fc80c, data reload: false

------ Round 1 ----------------------------------
q1	26229	5070	5018	5018
q2	1950	270	181	181
q3	10312	1229	686	686
q4	10235	1011	543	543
q5	7555	2417	2328	2328
q6	180	172	130	130
q7	889	757	617	617
q8	9297	1270	1130	1130
q9	6742	5129	5111	5111
q10	6853	2319	1894	1894
q11	497	284	273	273
q12	343	340	213	213
q13	17771	3715	3055	3055
q14	221	228	219	219
q15	556	478	491	478
q16	429	425	371	371
q17	600	867	366	366
q18	7707	7175	7093	7093
q19	1228	956	577	577
q20	348	342	236	236
q21	3954	2611	2350	2350
q22	1024	1029	977	977
Total cold run time: 114920 ms
Total hot run time: 33846 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5107	5081	5124	5081
q2	240	320	219	219
q3	2178	2623	2295	2295
q4	1341	1789	1364	1364
q5	4514	4440	4433	4433
q6	213	172	131	131
q7	2002	1923	1724	1724
q8	2565	2562	2479	2479
q9	7112	7055	7071	7055
q10	3011	3182	2745	2745
q11	579	518	489	489
q12	667	754	589	589
q13	3550	3809	3218	3218
q14	278	285	279	279
q15	523	472	490	472
q16	446	491	442	442
q17	1145	1474	1435	1435
q18	7720	7479	7394	7394
q19	796	818	876	818
q20	1969	2049	1886	1886
q21	5107	4500	4365	4365
q22	1079	1004	982	982
Total cold run time: 52142 ms
Total hot run time: 49895 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 184713 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0224cca4f93d6f0e3ea29b1a8e01f793540fc80c, data reload: false

query1	1009	479	504	479
query2	6557	1797	1775	1775
query3	6749	229	219	219
query4	26297	23242	23095	23095
query5	4406	630	460	460
query6	296	232	199	199
query7	4617	495	286	286
query8	272	227	216	216
query9	8620	2650	2674	2650
query10	480	341	278	278
query11	15231	15013	14857	14857
query12	148	104	102	102
query13	1643	517	402	402
query14	8602	6122	6151	6122
query15	219	202	169	169
query16	7135	619	487	487
query17	920	716	560	560
query18	1947	396	291	291
query19	201	181	170	170
query20	116	118	118	118
query21	221	121	105	105
query22	3983	4059	3861	3861
query23	33875	33054	33052	33052
query24	8409	2347	2406	2347
query25	567	450	389	389
query26	1234	262	151	151
query27	2758	502	341	341
query28	4357	2143	2129	2129
query29	802	544	434	434
query30	287	221	186	186
query31	918	860	747	747
query32	81	62	61	61
query33	557	360	313	313
query34	778	835	527	527
query35	775	816	740	740
query36	933	1005	904	904
query37	115	107	82	82
query38	4162	4163	4014	4014
query39	1557	1419	1440	1419
query40	213	120	110	110
query41	72	65	66	65
query42	126	111	112	111
query43	516	503	477	477
query44	1305	832	827	827
query45	196	185	168	168
query46	839	1010	629	629
query47	1766	1761	1694	1694
query48	403	429	329	329
query49	778	541	419	419
query50	651	668	407	407
query51	4077	4151	4091	4091
query52	122	109	102	102
query53	267	245	180	180
query54	576	570	503	503
query55	88	82	84	82
query56	309	299	280	280
query57	1145	1148	1074	1074
query58	276	261	247	247
query59	2560	2614	2544	2544
query60	333	321	304	304
query61	124	130	127	127
query62	800	688	643	643
query63	223	184	181	181
query64	4394	1046	679	679
query65	4260	4193	4133	4133
query66	1161	420	302	302
query67	15756	15468	15186	15186
query68	7861	889	525	525
query69	483	311	273	273
query70	1209	1092	1084	1084
query71	454	327	315	315
query72	5679	4756	4909	4756
query73	701	634	349	349
query74	9169	8886	8679	8679
query75	3772	3165	2690	2690
query76	3629	1183	735	735
query77	803	384	296	296
query78	9840	10076	9228	9228
query79	1951	827	591	591
query80	612	541	450	450
query81	479	259	221	221
query82	415	130	98	98
query83	286	255	240	240
query84	294	116	121	116
query85	790	363	308	308
query86	333	310	313	310
query87	4336	4455	4328	4328
query88	2882	2291	2348	2291
query89	377	315	277	277
query90	1914	209	201	201
query91	145	150	111	111
query92	77	60	58	58
query93	1135	928	588	588
query94	674	401	279	279
query95	375	292	288	288
query96	497	570	286	286
query97	2793	2748	2607	2607
query98	222	219	214	214
query99	1439	1413	1290	1290
Total cold run time: 270796 ms
Total hot run time: 184713 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.3 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0224cca4f93d6f0e3ea29b1a8e01f793540fc80c, data reload: false

query1	0.04	0.04	0.03
query2	0.12	0.11	0.10
query3	0.25	0.19	0.19
query4	1.59	0.19	0.19
query5	0.44	0.43	0.44
query6	1.16	0.67	0.67
query7	0.03	0.02	0.01
query8	0.05	0.04	0.04
query9	0.61	0.53	0.51
query10	0.58	0.58	0.56
query11	0.16	0.10	0.11
query12	0.16	0.11	0.11
query13	0.61	0.59	0.60
query14	0.79	0.81	0.80
query15	0.88	0.85	0.86
query16	0.37	0.38	0.38
query17	1.06	1.07	1.07
query18	0.21	0.21	0.21
query19	1.99	1.88	1.84
query20	0.02	0.02	0.02
query21	15.40	0.90	0.54
query22	0.77	1.06	0.65
query23	15.06	1.41	0.62
query24	7.30	1.56	0.92
query25	0.49	0.26	0.11
query26	0.70	0.16	0.14
query27	0.05	0.05	0.05
query28	10.16	0.87	0.45
query29	12.52	4.02	3.36
query30	0.25	0.10	0.06
query31	2.81	0.63	0.39
query32	3.23	0.56	0.47
query33	3.10	3.03	3.14
query34	15.60	5.07	4.50
query35	4.51	4.50	4.54
query36	0.67	0.49	0.49
query37	0.08	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.03
query40	0.16	0.14	0.13
query41	0.07	0.02	0.02
query42	0.03	0.02	0.03
query43	0.04	0.03	0.03
Total cold run time: 104.2 s
Total hot run time: 29.3 s

@codeDing18
Copy link
Contributor Author

run feut

1 similar comment
@codeDing18
Copy link
Contributor Author

run feut

@codeDing18
Copy link
Contributor Author

run cloud_p0

@codeDing18
Copy link
Contributor Author

run feut

1 similar comment
@codeDing18
Copy link
Contributor Author

run feut

@codeDing18
Copy link
Contributor Author

run cloud_p0

@hello-stephen
Copy link
Contributor

FE UT Coverage Report

Increment line coverage `` 🎉
Increment coverage report
Complete coverage report

@codeDing18
Copy link
Contributor Author

run feut

@codeDing18
Copy link
Contributor Author

run cloud_p0

@codeDing18
Copy link
Contributor Author

run feut

@hello-stephen
Copy link
Contributor

FE UT Coverage Report

Increment line coverage `` 🎉
Increment coverage report
Complete coverage report

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jun 6, 2025
Copy link
Contributor

github-actions bot commented Jun 6, 2025

PR approved by at least one committer and no changes requested.

Copy link
Contributor

github-actions bot commented Jun 6, 2025

PR approved by anyone and no changes requested.

@englefly englefly merged commit 8f11b0b into apache:master Jun 6, 2025
26 of 27 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants