Skip to content

[enhance](cloud)add log for compaction read time #51355

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 7 commits into
base: master
Choose a base branch
from
Open

[enhance](cloud)add log for compaction read time #51355

wants to merge 7 commits into from
+48 −0

Conversation

koarz
Copy link
Contributor

@koarz koarz commented May 29, 2025 •
edited
Loading

Problem Summary:

curl http://ip:8040/api/compaction/show?tablet_id=1748942349697

{
    ......
    "exec compaction time us": "217890",
    "compaction local read time us": "730",
    "compaction remote read time us": "0",
    ......
}

@Thearas
Copy link
Contributor

Thearas commented May 29, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@koarz
Copy link
Contributor Author

koarz commented May 29, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33985 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7a647f5c2b198d97fcb527173274800d6c638c1c, data reload: false

------ Round 1 ----------------------------------
q1	26490	5121	4999	4999
q2	1959	279	198	198
q3	10263	1254	685	685
q4	10239	996	529	529
q5	7513	2388	2372	2372
q6	187	162	130	130
q7	897	740	619	619
q8	9303	1283	1114	1114
q9	6872	5138	5143	5138
q10	6805	2307	1903	1903
q11	485	292	271	271
q12	333	351	225	225
q13	17801	3659	3133	3133
q14	230	225	219	219
q15	543	475	496	475
q16	417	427	377	377
q17	573	859	351	351
q18	7834	7294	7118	7118
q19	1220	936	552	552
q20	345	354	230	230
q21	3728	2568	2374	2374
q22	1041	1019	973	973
Total cold run time: 115078 ms
Total hot run time: 33985 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5082	5059	5058	5058
q2	243	321	217	217
q3	2155	2664	2246	2246
q4	1359	1786	1392	1392
q5	4484	4473	4379	4379
q6	221	167	124	124
q7	2044	1924	1751	1751
q8	2571	2566	2497	2497
q9	7203	7097	7168	7097
q10	3014	3218	2740	2740
q11	574	500	496	496
q12	701	769	611	611
q13	3482	4159	3351	3351
q14	281	309	289	289
q15	512	470	473	470
q16	471	489	448	448
q17	1139	1564	1371	1371
q18	7847	7523	7451	7451
q19	940	842	971	842
q20	2004	2025	1867	1867
q21	4776	4412	4285	4285
q22	1059	996	981	981
Total cold run time: 52162 ms
Total hot run time: 49963 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186417 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7a647f5c2b198d97fcb527173274800d6c638c1c, data reload: false

query1	1012	475	493	475
query2	6562	1788	1811	1788
query3	6766	222	215	215
query4	26055	23436	23362	23362
query5	4369	621	473	473
query6	304	215	201	201
query7	4647	496	305	305
query8	271	235	240	235
query9	8615	2666	2686	2666
query10	490	346	273	273
query11	15513	15065	14868	14868
query12	166	107	102	102
query13	1651	524	404	404
query14	9019	6218	6235	6218
query15	203	195	168	168
query16	7153	633	496	496
query17	1199	712	561	561
query18	1964	395	294	294
query19	193	192	166	166
query20	123	120	119	119
query21	211	125	111	111
query22	4082	4224	4198	4198
query23	34101	33176	33298	33176
query24	8489	2405	2421	2405
query25	593	494	435	435
query26	1258	286	164	164
query27	2744	498	346	346
query28	4327	2164	2158	2158
query29	783	592	474	474
query30	291	219	191	191
query31	935	846	772	772
query32	77	71	68	68
query33	570	387	335	335
query34	816	851	523	523
query35	783	842	735	735
query36	928	984	889	889
query37	112	101	78	78
query38	4167	4181	4106	4106
query39	1487	1408	1429	1408
query40	215	129	116	116
query41	71	69	68	68
query42	143	127	117	117
query43	568	511	467	467
query44	1389	842	838	838
query45	181	179	170	170
query46	845	1022	622	622
query47	1768	1768	1691	1691
query48	407	416	308	308
query49	752	501	380	380
query50	642	679	404	404
query51	4182	4090	4088	4088
query52	115	110	102	102
query53	227	266	196	196
query54	572	606	493	493
query55	83	85	90	85
query56	329	348	291	291
query57	1126	1123	1066	1066
query58	263	253	255	253
query59	2544	2770	2504	2504
query60	327	326	330	326
query61	123	154	128	128
query62	824	742	680	680
query63	231	203	200	200
query64	4333	1018	681	681
query65	4270	4157	4182	4157
query66	1182	428	315	315
query67	15999	15490	15400	15400
query68	9372	902	532	532
query69	478	318	273	273
query70	1247	1062	1045	1045
query71	477	332	303	303
query72	5217	4710	4613	4613
query73	705	575	353	353
query74	8874	9038	8940	8940
query75	4285	3198	2686	2686
query76	4135	1206	768	768
query77	984	382	301	301
query78	10162	10290	9387	9387
query79	2188	825	579	579
query80	643	525	443	443
query81	477	267	218	218
query82	424	128	105	105
query83	284	266	229	229
query84	300	108	92	92
query85	856	360	317	317
query86	353	293	273	273
query87	4396	4579	4292	4292
query88	3339	2306	2287	2287
query89	393	317	297	297
query90	1918	213	208	208
query91	142	152	114	114
query92	74	65	54	54
query93	1845	944	579	579
query94	679	421	286	286
query95	377	295	289	289
query96	497	565	284	284
query97	2761	2776	2655	2655
query98	250	219	209	209
query99	1432	1390	1299	1299
Total cold run time: 276304 ms
Total hot run time: 186417 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.97 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7a647f5c2b198d97fcb527173274800d6c638c1c, data reload: false

query1	0.04	0.04	0.04
query2	0.14	0.10	0.11
query3	0.26	0.20	0.19
query4	1.60	0.21	0.11
query5	0.44	0.41	0.44
query6	1.17	0.67	0.65
query7	0.03	0.01	0.02
query8	0.04	0.03	0.03
query9	0.58	0.52	0.50
query10	0.57	0.57	0.57
query11	0.15	0.11	0.11
query12	0.15	0.12	0.11
query13	0.62	0.60	0.59
query14	0.78	0.81	0.80
query15	0.87	0.86	0.85
query16	0.38	0.38	0.38
query17	1.02	1.03	1.03
query18	0.22	0.20	0.20
query19	1.89	1.88	1.78
query20	0.01	0.01	0.01
query21	15.42	0.89	0.54
query22	0.79	1.18	0.62
query23	14.93	1.36	0.58
query24	7.09	0.96	1.08
query25	0.49	0.11	0.16
query26	0.64	0.18	0.13
query27	0.05	0.06	0.05
query28	9.84	0.90	0.44
query29	12.55	3.96	3.30
query30	0.25	0.09	0.06
query31	2.83	0.59	0.40
query32	3.23	0.54	0.46
query33	3.08	3.13	3.06
query34	15.72	5.11	4.52
query35	4.49	4.53	4.47
query36	0.66	0.49	0.48
query37	0.08	0.06	0.06
query38	0.05	0.04	0.04
query39	0.04	0.03	0.02
query40	0.17	0.13	0.13
query41	0.09	0.03	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 103.53 s
Total hot run time: 28.97 s

@koarz koarz marked this pull request as ready for review May 29, 2025 09:40
@koarz
Copy link
Contributor Author

koarz commented May 29, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33705 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 08ff3bd91d1d34d36dbe3a94497b16091bd0569b, data reload: false

------ Round 1 ----------------------------------
q1	26077	5081	5012	5012
q2	1946	281	189	189
q3	10301	1277	703	703
q4	10215	1002	510	510
q5	7532	2369	2327	2327
q6	187	172	134	134
q7	898	732	612	612
q8	9313	1215	1072	1072
q9	6823	5137	5049	5049
q10	6856	2302	1890	1890
q11	498	280	273	273
q12	338	343	209	209
q13	17763	3650	3059	3059
q14	223	230	203	203
q15	555	481	489	481
q16	421	434	378	378
q17	587	853	350	350
q18	7574	7138	7199	7138
q19	1514	963	557	557
q20	329	341	220	220
q21	3680	3176	2368	2368
q22	1071	1012	971	971
Total cold run time: 114701 ms
Total hot run time: 33705 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5198	5084	5037	5037
q2	243	317	218	218
q3	2248	2695	2326	2326
q4	1358	1802	1429	1429
q5	4454	4373	4369	4369
q6	215	179	128	128
q7	2059	1953	1773	1773
q8	2605	2566	2506	2506
q9	7224	7103	7049	7049
q10	3061	3227	2758	2758
q11	576	552	496	496
q12	670	759	580	580
q13	3478	3925	3308	3308
q14	283	303	282	282
q15	527	499	488	488
q16	435	473	450	450
q17	1148	1551	1415	1415
q18	7730	7630	7470	7470
q19	781	753	795	753
q20	2009	1994	1845	1845
q21	4810	4480	4509	4480
q22	1060	1068	1038	1038
Total cold run time: 52172 ms
Total hot run time: 50198 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193531 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 08ff3bd91d1d34d36dbe3a94497b16091bd0569b, data reload: false

query1	1420	1107	1069	1069
query2	6407	1812	1791	1791
query3	11017	4450	4496	4450
query4	53607	25583	23715	23715
query5	5150	516	454	454
query6	373	218	225	218
query7	5104	498	289	289
query8	284	231	205	205
query9	6381	2635	2628	2628
query10	434	332	276	276
query11	15175	15034	15105	15034
query12	166	112	109	109
query13	1158	522	418	418
query14	10164	6350	6426	6350
query15	190	200	177	177
query16	6976	693	471	471
query17	1058	751	591	591
query18	1614	390	314	314
query19	212	194	172	172
query20	140	123	119	119
query21	205	123	110	110
query22	4459	4505	4360	4360
query23	34370	33638	33651	33638
query24	6735	2413	2457	2413
query25	485	479	417	417
query26	615	316	163	163
query27	2098	533	346	346
query28	2956	2174	2169	2169
query29	567	558	433	433
query30	277	233	194	194
query31	881	851	780	780
query32	75	62	62	62
query33	448	369	357	357
query34	779	865	554	554
query35	799	830	760	760
query36	918	1019	896	896
query37	122	100	78	78
query38	4282	4265	4312	4265
query39	1546	1462	1492	1462
query40	215	126	107	107
query41	61	58	57	57
query42	132	114	118	114
query43	498	518	469	469
query44	1362	871	858	858
query45	180	186	171	171
query46	871	1044	667	667
query47	1847	1889	1799	1799
query48	416	429	319	319
query49	678	519	409	409
query50	687	708	413	413
query51	4253	4234	4283	4234
query52	112	107	101	101
query53	226	262	187	187
query54	580	585	510	510
query55	91	87	85	85
query56	330	315	311	311
query57	1168	1200	1092	1092
query58	279	275	265	265
query59	2706	2781	2667	2667
query60	356	330	327	327
query61	152	156	192	156
query62	729	767	670	670
query63	228	202	206	202
query64	1442	1060	687	687
query65	4213	4130	4177	4130
query66	733	403	313	313
query67	15943	15600	15419	15419
query68	5476	859	536	536
query69	515	311	267	267
query70	1240	1057	1075	1057
query71	435	333	292	292
query72	6047	4886	4994	4886
query73	1112	705	357	357
query74	8956	9098	8854	8854
query75	3349	3203	2694	2694
query76	3717	1200	773	773
query77	545	389	285	285
query78	10029	10013	9431	9431
query79	2036	815	579	579
query80	846	523	445	445
query81	521	258	225	225
query82	393	126	103	103
query83	252	254	230	230
query84	290	103	88	88
query85	760	370	324	324
query86	421	293	302	293
query87	4463	4427	4285	4285
query88	2956	2270	2276	2270
query89	393	317	275	275
query90	1792	213	210	210
query91	142	141	118	118
query92	76	64	57	57
query93	2682	933	574	574
query94	695	416	288	288
query95	373	294	310	294
query96	483	572	280	280
query97	2761	2785	2647	2647
query98	232	206	198	198
query99	1311	1401	1270	1270
Total cold run time: 295434 ms
Total hot run time: 193531 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.39 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 08ff3bd91d1d34d36dbe3a94497b16091bd0569b, data reload: false

query1	0.04	0.04	0.03
query2	0.12	0.11	0.10
query3	0.25	0.19	0.20
query4	1.60	0.20	0.19
query5	0.45	0.44	0.44
query6	1.14	0.68	0.66
query7	0.03	0.01	0.02
query8	0.04	0.03	0.04
query9	0.59	0.52	0.55
query10	0.58	0.57	0.56
query11	0.15	0.11	0.11
query12	0.15	0.12	0.11
query13	0.62	0.60	0.60
query14	0.79	0.80	0.83
query15	0.88	0.86	0.84
query16	0.38	0.38	0.39
query17	1.05	1.06	1.02
query18	0.23	0.21	0.21
query19	1.88	1.84	1.86
query20	0.01	0.02	0.01
query21	15.39	0.92	0.53
query22	0.77	1.10	0.60
query23	15.05	1.37	0.64
query24	6.54	2.18	0.93
query25	0.51	0.24	0.21
query26	0.54	0.16	0.13
query27	0.05	0.05	0.04
query28	9.73	0.88	0.43
query29	12.72	3.99	3.42
query30	0.25	0.10	0.06
query31	2.83	0.60	0.39
query32	3.24	0.57	0.48
query33	3.04	3.04	3.03
query34	15.68	5.08	4.52
query35	4.50	4.58	4.51
query36	0.66	0.50	0.50
query37	0.08	0.06	0.06
query38	0.06	0.04	0.04
query39	0.03	0.02	0.02
query40	0.18	0.15	0.13
query41	0.08	0.02	0.03
query42	0.03	0.02	0.03
query43	0.04	0.03	0.03
Total cold run time: 102.98 s
Total hot run time: 29.39 s

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 11.76% (2/17) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 56.16% (15026/26758)
Line Coverage 45.07% (134137/297635)
Region Coverage 44.19% (67500/152766)
Branch Coverage 38.75% (34580/89238)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 11.76% (2/17) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.58% (20962/26342)
Line Coverage 72.75% (216520/297624)
Region Coverage 70.93% (127447/179671)
Branch Coverage 64.65% (65965/102038)

@koarz
Copy link
Contributor Author

koarz commented May 30, 2025

run p0

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 11.76% (2/17) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.56% (20959/26342)
Line Coverage 72.75% (216532/297624)
Region Coverage 70.97% (127518/179671)
Branch Coverage 64.65% (65971/102038)

@koarz
Copy link
Contributor Author

koarz commented May 30, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34094 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9442199557385cb919f791648d10158d49557f9d, data reload: false

------ Round 1 ----------------------------------
q1	26602	5039	5022	5022
q2	1973	300	185	185
q3	10276	1271	705	705
q4	10232	1017	537	537
q5	7535	2395	2383	2383
q6	187	164	131	131
q7	905	745	623	623
q8	9306	1312	1075	1075
q9	6878	5419	5099	5099
q10	6860	2309	1903	1903
q11	481	290	268	268
q12	333	347	218	218
q13	17774	3674	3202	3202
q14	229	227	219	219
q15	555	500	486	486
q16	429	433	383	383
q17	620	877	361	361
q18	7562	7257	7211	7211
q19	1486	964	561	561
q20	323	339	217	217
q21	3804	3187	2355	2355
q22	1074	1016	950	950
Total cold run time: 115424 ms
Total hot run time: 34094 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5095	5047	5075	5047
q2	236	323	224	224
q3	2144	2649	2356	2356
q4	1375	1966	1378	1378
q5	4436	4414	4444	4414
q6	219	172	137	137
q7	2010	1950	1775	1775
q8	2588	2532	2477	2477
q9	7305	7194	7202	7194
q10	3030	3201	2769	2769
q11	592	509	482	482
q12	715	762	662	662
q13	3541	3930	3415	3415
q14	281	286	271	271
q15	526	475	482	475
q16	441	504	444	444
q17	1149	1579	1370	1370
q18	7755	7770	7385	7385
q19	812	805	880	805
q20	2011	1978	1820	1820
q21	4905	4513	4450	4450
q22	1120	1081	993	993
Total cold run time: 52286 ms
Total hot run time: 50343 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192625 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9442199557385cb919f791648d10158d49557f9d, data reload: false

query1	1377	1088	1062	1062
query2	6229	1862	1823	1823
query3	11081	4387	4356	4356
query4	54428	25284	23012	23012
query5	5306	497	460	460
query6	435	211	200	200
query7	5434	511	289	289
query8	316	233	227	227
query9	7745	2653	2657	2653
query10	436	320	265	265
query11	15626	14938	14827	14827
query12	155	107	106	106
query13	1324	521	424	424
query14	10108	6316	6388	6316
query15	204	200	193	193
query16	6916	688	509	509
query17	1092	757	608	608
query18	1636	434	333	333
query19	203	200	174	174
query20	137	126	122	122
query21	210	128	111	111
query22	4378	4379	4260	4260
query23	34270	33470	33568	33470
query24	6561	2430	2444	2430
query25	486	476	415	415
query26	609	275	159	159
query27	2331	514	355	355
query28	2970	2171	2146	2146
query29	595	570	455	455
query30	272	220	191	191
query31	863	871	770	770
query32	70	65	63	63
query33	481	365	331	331
query34	778	875	536	536
query35	826	868	750	750
query36	938	1018	916	916
query37	121	97	81	81
query38	4212	4303	4211	4211
query39	1523	1447	1465	1447
query40	224	123	110	110
query41	60	76	58	58
query42	129	116	113	113
query43	509	523	475	475
query44	1329	833	847	833
query45	180	180	174	174
query46	886	1037	669	669
query47	1893	1866	1773	1773
query48	407	435	313	313
query49	676	496	403	403
query50	667	703	414	414
query51	4209	4283	4222	4222
query52	114	122	122	122
query53	235	266	196	196
query54	586	592	512	512
query55	88	83	82	82
query56	303	292	300	292
query57	1159	1186	1154	1154
query58	283	271	264	264
query59	2632	2772	2689	2689
query60	340	343	314	314
query61	131	132	143	132
query62	737	749	722	722
query63	237	206	202	202
query64	1503	1044	695	695
query65	4263	4173	4142	4142
query66	728	399	304	304
query67	16305	15926	15760	15760
query68	7308	856	530	530
query69	558	312	269	269
query70	1174	1082	1097	1082
query71	495	315	302	302
query72	5978	4740	4748	4740
query73	958	619	360	360
query74	9202	8843	8935	8843
query75	3753	3187	2692	2692
query76	4276	1193	743	743
query77	623	375	352	352
query78	10354	10042	9383	9383
query79	2378	815	589	589
query80	681	515	458	458
query81	486	256	225	225
query82	447	127	98	98
query83	401	255	232	232
query84	353	115	93	93
query85	802	368	315	315
query86	419	294	285	285
query87	4387	4423	4274	4274
query88	3379	2291	2280	2280
query89	421	318	292	292
query90	1763	210	207	207
query91	143	155	116	116
query92	70	70	55	55
query93	2222	952	587	587
query94	657	418	318	318
query95	380	302	285	285
query96	499	575	277	277
query97	2753	2800	2693	2693
query98	235	211	210	210
query99	1455	1414	1245	1245
Total cold run time: 302505 ms
Total hot run time: 192625 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.29 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9442199557385cb919f791648d10158d49557f9d, data reload: false

query1	0.04	0.04	0.03
query2	0.12	0.11	0.12
query3	0.25	0.20	0.19
query4	1.60	0.20	0.10
query5	0.44	0.43	0.44
query6	1.19	0.66	0.64
query7	0.03	0.01	0.02
query8	0.04	0.03	0.04
query9	0.57	0.53	0.52
query10	0.57	0.58	0.57
query11	0.16	0.11	0.12
query12	0.15	0.11	0.12
query13	0.62	0.60	0.60
query14	0.83	0.80	0.80
query15	0.88	0.85	0.88
query16	0.38	0.39	0.37
query17	1.05	1.06	1.02
query18	0.24	0.21	0.21
query19	1.93	1.89	1.87
query20	0.01	0.01	0.02
query21	15.41	0.90	0.54
query22	0.78	1.20	0.66
query23	14.91	1.34	0.65
query24	7.07	0.93	1.33
query25	0.50	0.18	0.15
query26	0.67	0.17	0.13
query27	0.05	0.05	0.04
query28	9.63	0.88	0.43
query29	12.58	4.04	3.35
query30	0.25	0.09	0.06
query31	2.84	0.61	0.39
query32	3.23	0.55	0.47
query33	3.13	3.04	3.11
query34	15.87	5.16	4.49
query35	4.51	4.56	4.57
query36	0.67	0.51	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.05
query39	0.03	0.03	0.03
query40	0.17	0.14	0.13
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 103.69 s
Total hot run time: 29.29 s

@dataroaring
Copy link
Contributor

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34498 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ae97809d4d3feaac3f4b6cd268b7d7ee0f060c2b, data reload: false

------ Round 1 ----------------------------------
q1	26311	5125	5047	5047
q2	1955	276	180	180
q3	10299	1244	724	724
q4	10226	1015	533	533
q5	7570	2390	2329	2329
q6	187	173	135	135
q7	925	720	594	594
q8	9315	1342	1082	1082
q9	6874	5047	5093	5047
q10	6899	2338	1907	1907
q11	490	289	267	267
q12	344	367	222	222
q13	17773	3663	3095	3095
q14	243	234	215	215
q15	562	481	496	481
q16	427	421	372	372
q17	613	867	360	360
q18	7631	7247	7054	7054
q19	1372	950	551	551
q20	338	344	226	226
q21	4217	3472	3109	3109
q22	1059	979	968	968
Total cold run time: 115630 ms
Total hot run time: 34498 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5221	5159	5139	5139
q2	246	311	220	220
q3	2157	2688	2260	2260
q4	1455	1812	1475	1475
q5	4478	4495	4429	4429
q6	223	171	130	130
q7	2015	1954	1762	1762
q8	2626	2567	2524	2524
q9	7219	7026	7228	7026
q10	3010	3384	2770	2770
q11	580	522	496	496
q12	706	782	624	624
q13	3585	3954	3437	3437
q14	281	301	281	281
q15	531	475	478	475
q16	458	512	461	461
q17	1184	1613	1375	1375
q18	7837	7552	7457	7457
q19	904	910	894	894
q20	1940	1961	1830	1830
q21	5011	4630	4504	4504
q22	1106	1054	1005	1005
Total cold run time: 52773 ms
Total hot run time: 50574 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192949 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ae97809d4d3feaac3f4b6cd268b7d7ee0f060c2b, data reload: false

query1	1401	1091	1079	1079
query2	6519	1864	1907	1864
query3	11039	4429	4373	4373
query4	54690	25500	23439	23439
query5	4985	512	470	470
query6	352	214	220	214
query7	4920	514	293	293
query8	292	229	216	216
query9	5818	2678	2671	2671
query10	446	324	261	261
query11	15109	14955	14815	14815
query12	154	109	111	109
query13	1058	523	404	404
query14	10198	6378	6382	6378
query15	206	209	190	190
query16	7026	668	452	452
query17	1078	760	601	601
query18	1542	424	317	317
query19	211	207	173	173
query20	139	139	125	125
query21	217	123	109	109
query22	4319	4513	4315	4315
query23	34462	33586	33660	33586
query24	6696	2448	2401	2401
query25	467	470	418	418
query26	745	277	155	155
query27	2270	541	361	361
query28	2981	2190	2186	2186
query29	580	586	437	437
query30	283	222	199	199
query31	866	848	767	767
query32	73	62	67	62
query33	454	357	317	317
query34	768	864	540	540
query35	782	846	765	765
query36	950	996	908	908
query37	124	115	86	86
query38	4207	4190	4204	4190
query39	1479	1430	1437	1430
query40	220	122	109	109
query41	62	57	85	57
query42	131	113	111	111
query43	504	556	493	493
query44	1330	844	859	844
query45	182	176	167	167
query46	844	1020	669	669
query47	1829	1886	1815	1815
query48	410	446	336	336
query49	654	491	409	409
query50	662	690	407	407
query51	4199	4300	4213	4213
query52	110	110	101	101
query53	234	258	196	196
query54	588	579	525	525
query55	88	88	84	84
query56	305	295	302	295
query57	1188	1183	1128	1128
query58	282	281	274	274
query59	2755	2904	2874	2874
query60	337	331	305	305
query61	133	135	130	130
query62	731	733	684	684
query63	229	189	186	186
query64	1703	1066	660	660
query65	4199	4085	4162	4085
query66	717	397	300	300
query67	15839	15682	15339	15339
query68	7324	882	520	520
query69	531	315	270	270
query70	1210	1077	1133	1077
query71	590	319	291	291
query72	5977	4767	4794	4767
query73	1399	627	353	353
query74	9259	9100	9261	9100
query75	3836	3183	2689	2689
query76	4219	1195	752	752
query77	638	375	281	281
query78	10087	10130	9361	9361
query79	2561	782	563	563
query80	638	503	446	446
query81	478	272	219	219
query82	446	122	104	104
query83	351	254	245	245
query84	298	109	94	94
query85	815	344	320	320
query86	362	310	281	281
query87	4442	4419	4291	4291
query88	3572	2270	2257	2257
query89	402	310	289	289
query90	1897	202	199	199
query91	143	145	117	117
query92	76	63	53	53
query93	1566	934	584	584
query94	671	384	314	314
query95	368	290	286	286
query96	508	569	276	276
query97	2739	2744	2606	2606
query98	231	202	200	200
query99	1465	1403	1272	1272
Total cold run time: 299470 ms
Total hot run time: 192949 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.4 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ae97809d4d3feaac3f4b6cd268b7d7ee0f060c2b, data reload: false

query1	0.04	0.04	0.03
query2	0.13	0.10	0.11
query3	0.24	0.20	0.19
query4	1.59	0.20	0.19
query5	0.47	0.45	0.44
query6	1.16	0.67	0.66
query7	0.03	0.02	0.01
query8	0.05	0.03	0.04
query9	0.58	0.52	0.54
query10	0.56	0.58	0.57
query11	0.16	0.11	0.11
query12	0.15	0.12	0.12
query13	0.61	0.60	0.60
query14	0.79	0.82	0.81
query15	0.88	0.87	0.85
query16	0.39	0.39	0.37
query17	1.02	1.06	1.04
query18	0.23	0.21	0.21
query19	1.94	1.80	1.80
query20	0.02	0.01	0.01
query21	15.39	0.87	0.53
query22	0.76	1.28	1.00
query23	14.79	1.38	0.61
query24	6.86	0.89	0.78
query25	0.47	0.26	0.12
query26	0.62	0.16	0.15
query27	0.05	0.05	0.06
query28	9.70	0.95	0.44
query29	12.56	3.96	3.32
query30	0.25	0.10	0.06
query31	2.82	0.59	0.38
query32	3.23	0.55	0.47
query33	3.03	3.04	3.05
query34	15.86	5.09	4.46
query35	4.50	4.52	4.53
query36	0.68	0.50	0.49
query37	0.08	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.17	0.14	0.12
query41	0.08	0.03	0.03
query42	0.04	0.03	0.02
query43	0.03	0.03	0.03
Total cold run time: 103.09 s
Total hot run time: 29.4 s

@doris-robot
Copy link

BE UT Coverage Report

Increment line coverage 5.00% (2/40) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 56.07% (15031/26809)
Line Coverage 44.95% (134182/298534)
Region Coverage 44.08% (67527/153186)
Branch Coverage 38.63% (34587/89528)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 5.00% (2/40) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.47% (20974/26393)
Line Coverage 72.53% (216523/298523)
Region Coverage 70.78% (127470/180101)
Branch Coverage 64.44% (65955/102348)

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Jun 3, 2025

PR approved by anyone and no changes requested.

@koarz
Copy link
Contributor Author

koarz commented Jun 3, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34738 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4cb5c794c59272ebec03b62ec7b594625d00d1f8, data reload: false

------ Round 1 ----------------------------------
q1	26391	5098	5091	5091
q2	1974	289	182	182
q3	10375	1224	718	718
q4	10230	1009	527	527
q5	7677	2390	2331	2331
q6	187	161	131	131
q7	909	724	603	603
q8	9318	1253	1070	1070
q9	6843	5385	5131	5131
q10	6865	2318	1893	1893
q11	489	295	290	290
q12	343	355	214	214
q13	17765	3701	3107	3107
q14	244	226	217	217
q15	566	487	500	487
q16	425	428	381	381
q17	625	866	387	387
q18	7864	7200	7255	7200
q19	1763	962	566	566
q20	344	350	241	241
q21	3750	3221	2981	2981
q22	1057	1039	990	990
Total cold run time: 116004 ms
Total hot run time: 34738 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5217	5025	5063	5025
q2	247	317	226	226
q3	2168	2650	2333	2333
q4	1361	1761	1507	1507
q5	4502	4414	4328	4328
q6	221	179	132	132
q7	1987	1889	1741	1741
q8	2561	2502	2559	2502
q9	7106	7197	7124	7124
q10	3006	3191	2736	2736
q11	586	519	496	496
q12	708	743	627	627
q13	3546	3892	3347	3347
q14	289	290	262	262
q15	528	466	464	464
q16	452	504	457	457
q17	1171	1465	1402	1402
q18	7820	7430	7474	7430
q19	806	839	831	831
q20	2003	2069	1902	1902
q21	4854	4349	4307	4307
q22	1050	1053	966	966
Total cold run time: 52189 ms
Total hot run time: 50145 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186054 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4cb5c794c59272ebec03b62ec7b594625d00d1f8, data reload: false

query1	1000	475	525	475
query2	6568	1850	1791	1791
query3	6765	235	222	222
query4	26707	23318	23897	23318
query5	4362	636	465	465
query6	308	210	207	207
query7	4623	494	305	305
query8	272	238	220	220
query9	8620	2680	2669	2669
query10	489	336	292	292
query11	15129	15033	14877	14877
query12	159	110	106	106
query13	1652	523	428	428
query14	8776	6104	6191	6104
query15	210	185	179	179
query16	7155	626	472	472
query17	1193	710	570	570
query18	1987	394	291	291
query19	190	205	160	160
query20	118	113	116	113
query21	217	124	110	110
query22	4135	4201	3946	3946
query23	33957	32994	33242	32994
query24	8408	2419	2413	2413
query25	537	457	392	392
query26	1252	266	147	147
query27	2762	522	341	341
query28	4321	2146	2137	2137
query29	796	567	438	438
query30	282	220	196	196
query31	916	844	763	763
query32	77	62	66	62
query33	573	358	328	328
query34	796	864	538	538
query35	773	796	729	729
query36	941	944	854	854
query37	114	104	77	77
query38	4124	4223	4017	4017
query39	1693	1493	1392	1392
query40	210	116	111	111
query41	65	62	60	60
query42	123	107	111	107
query43	487	487	472	472
query44	1303	817	832	817
query45	176	173	173	173
query46	850	1018	645	645
query47	1746	1781	1730	1730
query48	388	438	314	314
query49	751	458	401	401
query50	646	667	393	393
query51	4124	4112	4145	4112
query52	110	109	99	99
query53	224	256	190	190
query54	577	585	510	510
query55	85	84	86	84
query56	373	301	296	296
query57	1130	1112	1057	1057
query58	263	255	255	255
query59	2712	2614	2607	2607
query60	331	310	309	309
query61	128	127	129	127
query62	797	743	671	671
query63	230	188	188	188
query64	4381	1001	691	691
query65	4277	4136	4168	4136
query66	1150	419	316	316
query67	16074	15691	15314	15314
query68	6944	905	545	545
query69	487	311	275	275
query70	1183	1116	1066	1066
query71	407	335	298	298
query72	5580	4785	4886	4785
query73	669	632	353	353
query74	9119	9167	8991	8991
query75	3154	3179	2720	2720
query76	3190	1179	779	779
query77	475	390	300	300
query78	10039	10322	9447	9447
query79	1606	788	628	628
query80	657	527	449	449
query81	480	256	218	218
query82	211	125	94	94
query83	249	247	238	238
query84	251	113	93	93
query85	747	348	316	316
query86	311	285	307	285
query87	4353	4556	4287	4287
query88	2865	2275	2290	2275
query89	385	334	285	285
query90	1781	215	204	204
query91	139	147	113	113
query92	64	63	55	55
query93	1019	931	597	597
query94	618	410	296	296
query95	369	294	279	279
query96	491	582	288	288
query97	2684	2758	2662	2662
query98	225	218	205	205
query99	1322	1407	1305	1305
Total cold run time: 268742 ms
Total hot run time: 186054 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.74 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4cb5c794c59272ebec03b62ec7b594625d00d1f8, data reload: false

query1	0.04	0.04	0.03
query2	0.14	0.10	0.12
query3	0.24	0.20	0.19
query4	1.60	0.20	0.10
query5	0.42	0.42	0.42
query6	1.17	0.67	0.65
query7	0.03	0.02	0.02
query8	0.04	0.04	0.04
query9	0.59	0.52	0.52
query10	0.56	0.58	0.57
query11	0.16	0.12	0.11
query12	0.15	0.12	0.11
query13	0.62	0.61	0.59
query14	0.79	0.81	0.81
query15	0.87	0.87	0.88
query16	0.38	0.38	0.37
query17	1.03	1.01	1.07
query18	0.22	0.21	0.21
query19	1.89	1.83	1.81
query20	0.02	0.01	0.01
query21	15.43	0.92	0.52
query22	0.75	1.22	0.71
query23	14.86	1.36	0.67
query24	7.61	1.28	0.41
query25	0.50	0.17	0.13
query26	0.59	0.17	0.14
query27	0.05	0.05	0.06
query28	8.84	0.91	0.47
query29	12.53	4.04	3.36
query30	0.26	0.09	0.06
query31	2.82	0.61	0.40
query32	3.23	0.55	0.48
query33	3.01	3.02	3.15
query34	15.80	5.14	4.47
query35	4.53	4.55	4.51
query36	0.68	0.49	0.48
query37	0.09	0.07	0.06
query38	0.06	0.04	0.04
query39	0.03	0.03	0.02
query40	0.16	0.14	0.13
query41	0.08	0.02	0.02
query42	0.04	0.03	0.02
query43	0.04	0.04	0.03
Total cold run time: 102.95 s
Total hot run time: 28.74 s

@koarz
Copy link
Contributor Author

koarz commented Jun 4, 2025

run external

@koarz
Copy link
Contributor Author

koarz commented Jun 4, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34342 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6456b92a0c36b07a26b6274d4868265da2f795a2, data reload: false

------ Round 1 ----------------------------------
q1	26544	5678	4998	4998
q2	2001	301	189	189
q3	10254	1342	691	691
q4	10230	990	511	511
q5	7519	2379	2285	2285
q6	180	168	132	132
q7	909	726	612	612
q8	9308	1285	1085	1085
q9	6844	5065	5075	5065
q10	6870	2314	1927	1927
q11	510	291	277	277
q12	341	348	216	216
q13	17810	3668	3084	3084
q14	233	230	211	211
q15	560	486	479	479
q16	426	439	374	374
q17	639	873	383	383
q18	7652	7189	7039	7039
q19	2018	992	589	589
q20	328	346	242	242
q21	3824	3126	2984	2984
q22	1007	1016	969	969
Total cold run time: 116007 ms
Total hot run time: 34342 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5164	5069	5025	5025
q2	239	317	225	225
q3	2256	2681	2297	2297
q4	1367	1801	1483	1483
q5	4475	4424	4438	4424
q6	221	174	127	127
q7	2018	1960	1789	1789
q8	2596	2876	2533	2533
q9	7268	7106	7188	7106
q10	3014	3175	2732	2732
q11	567	497	505	497
q12	700	797	632	632
q13	3492	3853	3331	3331
q14	277	290	261	261
q15	549	510	508	508
q16	450	491	433	433
q17	1167	1558	1391	1391
q18	7753	7561	7487	7487
q19	845	865	1088	865
q20	1947	1965	1852	1852
q21	4761	4568	4391	4391
q22	1114	1064	1031	1031
Total cold run time: 52240 ms
Total hot run time: 50420 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193286 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6456b92a0c36b07a26b6274d4868265da2f795a2, data reload: false

query1	1433	1089	1063	1063
query2	6270	1877	1875	1875
query3	11006	4537	4310	4310
query4	52390	26325	23488	23488
query5	5187	513	472	472
query6	357	213	209	209
query7	4921	512	294	294
query8	288	242	216	216
query9	5590	2661	2646	2646
query10	455	360	276	276
query11	15114	14987	14857	14857
query12	168	109	115	109
query13	1088	525	415	415
query14	10217	6288	6444	6288
query15	208	218	180	180
query16	7118	679	516	516
query17	1088	752	604	604
query18	1555	428	323	323
query19	213	212	177	177
query20	131	140	124	124
query21	221	132	109	109
query22	4388	4461	4244	4244
query23	34271	33614	33610	33610
query24	6596	2449	2431	2431
query25	469	464	413	413
query26	730	274	155	155
query27	2364	528	349	349
query28	3094	2185	2172	2172
query29	595	568	446	446
query30	273	235	189	189
query31	856	889	794	794
query32	78	66	64	64
query33	451	366	323	323
query34	819	876	548	548
query35	809	852	742	742
query36	959	998	899	899
query37	117	101	78	78
query38	4269	4292	4300	4292
query39	1530	1673	1431	1431
query40	213	128	136	128
query41	68	61	58	58
query42	129	115	107	107
query43	509	502	475	475
query44	1332	835	818	818
query45	188	178	173	173
query46	871	1035	666	666
query47	1830	1861	1775	1775
query48	413	437	336	336
query49	706	511	396	396
query50	690	703	411	411
query51	4278	4291	4304	4291
query52	118	115	112	112
query53	242	269	193	193
query54	585	580	538	538
query55	87	100	83	83
query56	322	309	299	299
query57	1177	1217	1142	1142
query58	267	293	276	276
query59	2738	2804	2724	2724
query60	381	332	313	313
query61	126	130	145	130
query62	754	729	690	690
query63	240	189	200	189
query64	1787	1077	694	694
query65	4254	4156	4153	4153
query66	718	394	304	304
query67	16142	15655	15386	15386
query68	7528	905	519	519
query69	556	314	271	271
query70	1224	1140	1119	1119
query71	501	315	307	307
query72	5955	4906	5096	4906
query73	1473	699	350	350
query74	9321	9065	9000	9000
query75	3801	3243	2703	2703
query76	4137	1210	753	753
query77	617	364	278	278
query78	10100	10019	9283	9283
query79	2946	829	578	578
query80	636	507	439	439
query81	480	265	232	232
query82	462	125	97	97
query83	353	255	237	237
query84	296	111	84	84
query85	810	354	323	323
query86	389	351	294	294
query87	4461	4501	4352	4352
query88	3717	2263	2293	2263
query89	393	306	282	282
query90	1837	218	220	218
query91	146	150	119	119
query92	79	65	56	56
query93	2001	958	578	578
query94	669	424	293	293
query95	373	293	290	290
query96	499	578	282	282
query97	2737	2763	2702	2702
query98	246	212	204	204
query99	1495	1385	1283	1283
Total cold run time: 299089 ms
Total hot run time: 193286 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.13 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6456b92a0c36b07a26b6274d4868265da2f795a2, data reload: false

query1	0.04	0.04	0.03
query2	0.12	0.10	0.11
query3	0.25	0.19	0.19
query4	1.60	0.20	0.11
query5	0.44	0.41	0.44
query6	1.15	0.66	0.67
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.57	0.53	0.52
query10	0.58	0.59	0.57
query11	0.16	0.11	0.10
query12	0.14	0.12	0.12
query13	0.63	0.61	0.61
query14	0.84	0.80	0.81
query15	0.88	0.84	0.87
query16	0.39	0.38	0.40
query17	1.09	1.03	1.10
query18	0.22	0.22	0.21
query19	1.99	1.86	1.81
query20	0.01	0.01	0.02
query21	15.42	0.91	0.53
query22	0.77	1.20	0.68
query23	14.91	1.38	0.62
query24	7.38	0.96	0.98
query25	0.50	0.10	0.14
query26	0.70	0.17	0.13
query27	0.06	0.05	0.04
query28	8.47	0.88	0.45
query29	12.55	4.06	3.32
query30	0.26	0.09	0.06
query31	2.82	0.61	0.40
query32	3.23	0.56	0.47
query33	3.07	3.01	3.12
query34	15.88	5.09	4.48
query35	4.54	4.56	4.52
query36	0.69	0.50	0.48
query37	0.09	0.06	0.06
query38	0.06	0.04	0.04
query39	0.03	0.02	0.02
query40	0.17	0.16	0.14
query41	0.08	0.02	0.02
query42	0.04	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 102.92 s
Total hot run time: 29.13 s

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 5.41% (2/37) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 56.32% (15092/26798)
Line Coverage 45.09% (134678/298714)
Region Coverage 44.20% (67734/153249)
Branch Coverage 38.74% (34712/89612)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 5.41% (2/37) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.60% (20999/26379)
Line Coverage 72.66% (216960/298611)
Region Coverage 70.93% (127724/180082)
Branch Coverage 64.59% (66131/102382)

1 similar comment
@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 5.41% (2/37) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.60% (20999/26379)
Line Coverage 72.66% (216960/298611)
Region Coverage 70.93% (127724/180082)
Branch Coverage 64.59% (66131/102382)

dataroaring
dataroaring previously approved these changes Jun 5, 2025
View reviewed changes
Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jun 5, 2025
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Jun 5, 2025

PR approved by at least one committer and no changes requested.

luwei16
luwei16 reviewed Jun 6, 2025
View reviewed changes
be/src/olap/merger.cpp
@@ -147,6 +148,12 @@ Status Merger::vmerge_rowsets(BaseTabletSPtr tablet, ReaderType reader_type,
stats_output->bytes_read_from_remote =
reader.stats().file_cache_stats.bytes_read_from_remote;
stats_output->cached_bytes_total = reader.stats().file_cache_stats.bytes_write_into_cache;
if (config::is_cloud_mode()) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What would happen if there is no cloud mode judgment?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nothing will happen, but I think these calculations are not necessary.

@koarz
Copy link
Contributor Author

koarz commented Jun 9, 2025

run buildall

@github-actions github-actions bot removed the approved Indicates a PR has been approved by one committer. label Jun 9, 2025
@doris-robot
Copy link

TPC-H: Total hot run time: 33864 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 93eb822f4c52b23aa18307b31374b9ada6772a9e, data reload: false

------ Round 1 ----------------------------------
q1	26207	4942	4939	4939
q2	1945	274	180	180
q3	10310	1265	705	705
q4	10228	996	541	541
q5	7528	2328	2329	2328
q6	174	158	132	132
q7	904	713	593	593
q8	9295	1279	1134	1134
q9	6965	5151	5132	5132
q10	6862	2301	1887	1887
q11	488	291	273	273
q12	334	342	221	221
q13	17770	3602	3102	3102
q14	234	245	216	216
q15	565	481	474	474
q16	425	432	373	373
q17	607	854	363	363
q18	7569	7140	7155	7140
q19	1610	944	543	543
q20	340	339	217	217
q21	3734	3173	2421	2421
q22	1062	985	950	950
Total cold run time: 115156 ms
Total hot run time: 33864 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5104	5001	5015	5001
q2	232	308	224	224
q3	2128	2631	2264	2264
q4	1371	1768	1295	1295
q5	4394	4306	4412	4306
q6	228	174	127	127
q7	1998	1906	1770	1770
q8	2606	2575	2523	2523
q9	7193	7222	6988	6988
q10	2992	3148	2718	2718
q11	576	502	490	490
q12	668	769	591	591
q13	3473	3907	3258	3258
q14	283	299	282	282
q15	519	479	497	479
q16	469	489	454	454
q17	1209	1571	1354	1354
q18	7663	7510	7407	7407
q19	834	867	1059	867
q20	1954	2062	1909	1909
q21	4764	4441	4388	4388
q22	1081	1059	1029	1029
Total cold run time: 51739 ms
Total hot run time: 49724 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191995 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 93eb822f4c52b23aa18307b31374b9ada6772a9e, data reload: false

query1	1408	1110	1061	1061
query2	6269	1832	1862	1832
query3	10996	4584	4622	4584
query4	54908	24323	22857	22857
query5	5135	557	487	487
query6	362	206	200	200
query7	4971	520	295	295
query8	289	238	209	209
query9	5922	2642	2624	2624
query10	438	345	275	275
query11	15172	14963	15342	14963
query12	159	110	116	110
query13	1079	534	423	423
query14	10166	6082	6242	6082
query15	200	195	171	171
query16	7132	638	491	491
query17	1077	741	563	563
query18	1593	409	300	300
query19	201	199	174	174
query20	125	122	123	122
query21	226	128	104	104
query22	4384	4413	4279	4279
query23	34161	33451	33675	33451
query24	6667	2427	2432	2427
query25	465	486	427	427
query26	673	276	148	148
query27	2171	514	347	347
query28	2911	2150	2142	2142
query29	590	563	423	423
query30	271	227	191	191
query31	874	850	776	776
query32	67	66	62	62
query33	459	364	314	314
query34	822	864	539	539
query35	793	848	783	783
query36	948	1016	917	917
query37	116	102	78	78
query38	4210	4303	4246	4246
query39	1585	1441	1441	1441
query40	222	129	115	115
query41	73	71	64	64
query42	157	110	108	108
query43	509	536	478	478
query44	1357	859	879	859
query45	184	171	170	170
query46	859	1047	656	656
query47	1841	1876	1820	1820
query48	395	430	318	318
query49	654	484	398	398
query50	671	691	424	424
query51	4204	4269	4190	4190
query52	109	120	106	106
query53	235	268	196	196
query54	591	592	526	526
query55	91	85	82	82
query56	316	314	337	314
query57	1212	1287	1164	1164
query58	279	267	255	255
query59	2737	2777	2775	2775
query60	343	329	316	316
query61	124	124	146	124
query62	729	719	672	672
query63	237	199	200	199
query64	1477	1091	707	707
query65	4282	4142	4127	4127
query66	703	399	300	300
query67	15996	15821	15460	15460
query68	7132	901	534	534
query69	534	310	268	268
query70	1207	1086	1089	1086
query71	510	328	296	296
query72	5781	4747	4889	4747
query73	1187	604	354	354
query74	9072	9083	8697	8697
query75	3912	3216	2703	2703
query76	4198	1196	769	769
query77	626	367	282	282
query78	10217	10073	9339	9339
query79	2549	811	599	599
query80	652	587	446	446
query81	485	255	218	218
query82	439	126	90	90
query83	358	243	229	229
query84	306	96	81	81
query85	765	352	322	322
query86	385	305	279	279
query87	4475	4370	4225	4225
query88	3463	2304	2305	2304
query89	402	319	279	279
query90	1785	210	206	206
query91	147	139	112	112
query92	76	58	56	56
query93	2113	970	603	603
query94	664	417	305	305
query95	369	293	289	289
query96	499	573	285	285
query97	2711	2749	2696	2696
query98	226	214	200	200
query99	1439	1395	1255	1255
Total cold run time: 299266 ms
Total hot run time: 191995 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.7 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 93eb822f4c52b23aa18307b31374b9ada6772a9e, data reload: false

query1	0.04	0.04	0.03
query2	0.13	0.10	0.12
query3	0.26	0.20	0.20
query4	1.59	0.19	0.20
query5	0.47	0.44	0.46
query6	1.16	0.67	0.66
query7	0.02	0.01	0.02
query8	0.05	0.04	0.03
query9	0.60	0.52	0.53
query10	0.56	0.56	0.57
query11	0.16	0.11	0.11
query12	0.15	0.12	0.12
query13	0.62	0.59	0.60
query14	0.78	0.81	0.80
query15	0.86	0.85	0.86
query16	0.38	0.40	0.38
query17	1.01	1.05	1.09
query18	0.23	0.22	0.21
query19	1.95	1.83	1.79
query20	0.01	0.01	0.02
query21	15.41	0.92	0.53
query22	0.77	1.12	0.73
query23	14.94	1.40	0.61
query24	7.71	1.12	0.37
query25	0.46	0.23	0.08
query26	0.60	0.16	0.13
query27	0.05	0.05	0.06
query28	9.70	0.86	0.45
query29	12.56	4.03	3.35
query30	0.25	0.10	0.06
query31	2.83	0.61	0.39
query32	3.22	0.55	0.47
query33	3.07	3.08	3.07
query34	15.73	5.07	4.50
query35	4.48	4.52	4.45
query36	0.67	0.49	0.49
query37	0.08	0.06	0.06
query38	0.06	0.04	0.03
query39	0.03	0.03	0.03
query40	0.17	0.14	0.13
query41	0.07	0.03	0.03
query42	0.03	0.03	0.02
query43	0.04	0.03	0.02
Total cold run time: 103.96 s
Total hot run time: 28.7 s

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 5.41% (2/37) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 56.39% (15067/26718)
Line Coverage 45.15% (134641/298224)
Region Coverage 44.25% (67742/153103)
Branch Coverage 38.81% (34741/89510)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 5.41% (2/37) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.70% (20959/26297)
Line Coverage 72.64% (216521/298078)
Region Coverage 70.89% (127668/180098)
Branch Coverage 64.49% (65985/102322)

@koarz
Copy link
Contributor Author

koarz commented Jun 10, 2025

run p0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@luwei16 luwei16 luwei16 left review comments

@Yukang-Lian Yukang-Lian Yukang-Lian approved these changes

@dataroaring dataroaring dataroaring left review comments

@gavinchou gavinchou Awaiting requested review from gavinchou gavinchou is a code owner

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
7 participants
@koarz @Thearas @doris-robot @hello-stephen @dataroaring @luwei16 @Yukang-Lian