Skip to content

[Enhancement](nereids)support show export #51360

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
May 30, 2025

Conversation

lsy3993
Copy link
Contributor

@lsy3993 lsy3993 commented May 29, 2025

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
      show export will execute by nereids
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@lsy3993
Copy link
Contributor Author

lsy3993 commented May 29, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33723 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 49ccdf20203335e930a67e93b4af261fce7b4cf8, data reload: false

------ Round 1 ----------------------------------
q1	25740	5044	4967	4967
q2	1930	268	175	175
q3	10317	1211	666	666
q4	10229	1015	515	515
q5	7516	2358	2309	2309
q6	178	160	130	130
q7	913	723	612	612
q8	9311	1265	1134	1134
q9	6803	5072	5039	5039
q10	6859	2301	1916	1916
q11	480	283	272	272
q12	339	343	207	207
q13	17766	3686	3115	3115
q14	227	238	220	220
q15	562	480	488	480
q16	418	433	376	376
q17	587	822	373	373
q18	7552	7088	7084	7084
q19	1825	1090	552	552
q20	323	331	225	225
q21	3561	3113	2360	2360
q22	1061	1041	996	996
Total cold run time: 114497 ms
Total hot run time: 33723 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5133	5021	5119	5021
q2	238	315	219	219
q3	2163	2638	2362	2362
q4	1356	1766	1352	1352
q5	4365	4342	4379	4342
q6	212	168	133	133
q7	1965	1923	1780	1780
q8	2586	2550	2495	2495
q9	7200	7221	7004	7004
q10	3014	3201	2746	2746
q11	568	510	494	494
q12	677	756	589	589
q13	3495	4262	3293	3293
q14	277	298	296	296
q15	531	501	478	478
q16	434	485	434	434
q17	1141	1520	1481	1481
q18	7725	7508	7371	7371
q19	789	890	952	890
q20	1997	2069	1830	1830
q21	4867	4448	4348	4348
q22	1085	1062	1041	1041
Total cold run time: 51818 ms
Total hot run time: 49999 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193226 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 49ccdf20203335e930a67e93b4af261fce7b4cf8, data reload: false

query1	1424	1078	1061	1061
query2	6337	1812	1818	1812
query3	11000	4493	4519	4493
query4	53323	25386	23088	23088
query5	5034	594	451	451
query6	350	211	198	198
query7	4884	511	289	289
query8	293	239	213	213
query9	5448	2645	2659	2645
query10	443	331	277	277
query11	15044	14998	14900	14900
query12	160	108	107	107
query13	1033	535	407	407
query14	10123	6331	6404	6331
query15	200	197	190	190
query16	7158	635	486	486
query17	1082	721	596	596
query18	1546	407	346	346
query19	209	199	164	164
query20	124	129	117	117
query21	213	123	108	108
query22	4453	4421	4310	4310
query23	34239	33679	33899	33679
query24	6522	2415	2409	2409
query25	463	469	410	410
query26	685	275	156	156
query27	2346	503	351	351
query28	3003	2180	2180	2180
query29	600	563	434	434
query30	271	219	195	195
query31	882	848	782	782
query32	74	69	60	60
query33	444	359	326	326
query34	798	890	539	539
query35	807	852	754	754
query36	918	1016	910	910
query37	112	96	79	79
query38	4203	4324	4214	4214
query39	1522	1462	1630	1462
query40	208	118	113	113
query41	61	58	60	58
query42	123	113	107	107
query43	493	497	481	481
query44	1358	853	849	849
query45	184	183	168	168
query46	847	1036	661	661
query47	1845	1905	1816	1816
query48	423	450	321	321
query49	652	479	406	406
query50	708	720	435	435
query51	4219	4256	4240	4240
query52	118	111	112	111
query53	239	264	191	191
query54	599	597	520	520
query55	90	83	84	83
query56	331	334	299	299
query57	1166	1214	1133	1133
query58	273	282	266	266
query59	2758	2776	2666	2666
query60	316	326	306	306
query61	126	127	130	127
query62	712	725	659	659
query63	235	187	183	183
query64	1449	1024	705	705
query65	4206	4148	4162	4148
query66	723	402	302	302
query67	16067	15661	15573	15573
query68	5610	839	532	532
query69	531	308	270	270
query70	1188	1135	1132	1132
query71	459	320	299	299
query72	6048	4889	4879	4879
query73	1402	614	351	351
query74	8917	9130	8963	8963
query75	3206	3234	2705	2705
query76	3848	1197	756	756
query77	527	364	281	281
query78	10049	10295	9358	9358
query79	2870	840	577	577
query80	751	506	450	450
query81	497	255	222	222
query82	706	127	103	103
query83	262	244	231	231
query84	296	119	91	91
query85	854	361	323	323
query86	397	324	293	293
query87	4416	4511	4441	4441
query88	3438	2289	2272	2272
query89	408	318	288	288
query90	1673	210	207	207
query91	140	139	112	112
query92	76	63	55	55
query93	2606	932	585	585
query94	773	414	289	289
query95	369	294	286	286
query96	494	574	283	283
query97	2803	2786	2640	2640
query98	236	210	197	197
query99	1632	1391	1299	1299
Total cold run time: 295781 ms
Total hot run time: 193226 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.78 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 49ccdf20203335e930a67e93b4af261fce7b4cf8, data reload: false

query1	0.04	0.04	0.03
query2	0.13	0.10	0.11
query3	0.25	0.20	0.20
query4	1.60	0.20	0.10
query5	0.44	0.44	0.43
query6	1.17	0.66	0.65
query7	0.03	0.02	0.01
query8	0.04	0.04	0.03
query9	0.59	0.51	0.53
query10	0.58	0.59	0.56
query11	0.15	0.10	0.11
query12	0.15	0.12	0.12
query13	0.62	0.61	0.60
query14	0.78	0.80	0.81
query15	0.88	0.86	0.86
query16	0.38	0.38	0.38
query17	1.06	1.06	1.07
query18	0.23	0.21	0.21
query19	1.93	1.80	1.79
query20	0.01	0.02	0.01
query21	15.39	0.89	0.55
query22	0.75	1.21	0.67
query23	14.90	1.41	0.62
query24	6.78	1.71	0.51
query25	0.51	0.19	0.20
query26	0.63	0.16	0.14
query27	0.05	0.05	0.06
query28	9.80	0.91	0.44
query29	12.54	3.97	3.31
query30	0.26	0.09	0.06
query31	2.82	0.61	0.38
query32	3.22	0.54	0.48
query33	3.19	3.16	3.06
query34	15.71	5.05	4.48
query35	4.48	4.51	4.48
query36	0.65	0.50	0.48
query37	0.09	0.07	0.07
query38	0.06	0.04	0.04
query39	0.03	0.02	0.02
query40	0.17	0.14	0.13
query41	0.08	0.02	0.03
query42	0.03	0.03	0.03
query43	0.04	0.02	0.03
Total cold run time: 103.24 s
Total hot run time: 28.78 s

@lsy3993
Copy link
Contributor Author

lsy3993 commented May 29, 2025

run external

@lsy3993
Copy link
Contributor Author

lsy3993 commented May 30, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33883 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c152ac8b6a931f116cde430b717181084effd333, data reload: false

------ Round 1 ----------------------------------
q1	26276	5145	5017	5017
q2	1940	289	193	193
q3	10312	1255	699	699
q4	10266	1013	527	527
q5	8807	2458	2342	2342
q6	187	162	136	136
q7	893	738	609	609
q8	9312	1292	1103	1103
q9	6755	5145	5079	5079
q10	6857	2328	1895	1895
q11	495	290	284	284
q12	339	355	226	226
q13	17804	3670	3211	3211
q14	243	236	219	219
q15	559	500	497	497
q16	440	436	373	373
q17	574	867	357	357
q18	7605	7147	7014	7014
q19	1364	936	567	567
q20	327	342	223	223
q21	3691	3180	2349	2349
q22	1048	1017	963	963
Total cold run time: 116094 ms
Total hot run time: 33883 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5098	5116	5111	5111
q2	236	320	223	223
q3	2163	2640	2291	2291
q4	1335	1770	1378	1378
q5	4579	4472	4405	4405
q6	210	172	125	125
q7	2020	1907	1803	1803
q8	2556	2680	2564	2564
q9	7116	7120	7206	7120
q10	3024	3218	2717	2717
q11	578	514	499	499
q12	679	771	588	588
q13	3581	3921	3329	3329
q14	272	305	270	270
q15	518	479	486	479
q16	457	474	437	437
q17	1142	1595	1357	1357
q18	7702	7449	7334	7334
q19	804	809	820	809
q20	1986	2024	1845	1845
q21	4862	4307	4488	4307
q22	1089	1042	1028	1028
Total cold run time: 52007 ms
Total hot run time: 50019 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 185904 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c152ac8b6a931f116cde430b717181084effd333, data reload: false

query1	1020	484	494	484
query2	6558	1822	1796	1796
query3	6750	230	218	218
query4	26505	23524	22889	22889
query5	4356	643	478	478
query6	303	206	203	203
query7	4629	489	300	300
query8	268	236	212	212
query9	8627	2626	2629	2626
query10	480	343	282	282
query11	15647	15066	14867	14867
query12	170	110	106	106
query13	1674	535	412	412
query14	9700	6270	6237	6237
query15	212	193	169	169
query16	7447	660	486	486
query17	1169	692	566	566
query18	2014	389	291	291
query19	186	185	158	158
query20	117	116	118	116
query21	216	123	106	106
query22	4088	4084	4016	4016
query23	33870	32973	33201	32973
query24	8490	2398	2401	2398
query25	554	447	409	409
query26	1221	278	151	151
query27	2756	510	329	329
query28	4312	2145	2137	2137
query29	733	568	433	433
query30	284	214	193	193
query31	955	851	744	744
query32	75	62	63	62
query33	554	355	319	319
query34	795	865	527	527
query35	795	817	738	738
query36	961	966	889	889
query37	112	99	79	79
query38	4148	4288	4190	4190
query39	1456	1415	1412	1412
query40	213	125	112	112
query41	63	61	58	58
query42	123	116	116	116
query43	492	514	462	462
query44	1301	832	815	815
query45	178	177	169	169
query46	851	1031	625	625
query47	1774	1818	1724	1724
query48	410	430	313	313
query49	769	479	382	382
query50	641	681	412	412
query51	4095	4080	4121	4080
query52	112	103	94	94
query53	218	255	184	184
query54	565	563	496	496
query55	87	81	89	81
query56	295	301	282	282
query57	1143	1136	1090	1090
query58	273	259	265	259
query59	2759	2724	2628	2628
query60	340	334	310	310
query61	127	129	133	129
query62	807	730	691	691
query63	223	195	197	195
query64	4278	1024	766	766
query65	4186	4152	4125	4125
query66	1158	440	319	319
query67	15769	15543	15489	15489
query68	7860	906	534	534
query69	472	319	285	285
query70	1186	1075	1020	1020
query71	467	322	365	322
query72	5542	4798	4742	4742
query73	675	604	365	365
query74	9051	8961	8695	8695
query75	3812	3224	2690	2690
query76	3666	1228	756	756
query77	785	381	294	294
query78	10156	10341	9462	9462
query79	2270	789	572	572
query80	587	518	449	449
query81	496	269	222	222
query82	455	127	97	97
query83	262	249	228	228
query84	245	118	96	96
query85	792	363	327	327
query86	401	310	271	271
query87	4433	4474	4468	4468
query88	3700	2309	2294	2294
query89	386	312	294	294
query90	1879	216	205	205
query91	142	145	115	115
query92	81	61	61	61
query93	1837	930	595	595
query94	698	418	315	315
query95	370	289	279	279
query96	497	584	284	284
query97	2741	2739	2666	2666
query98	235	210	201	201
query99	1425	1380	1293	1293
Total cold run time: 275061 ms
Total hot run time: 185904 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.95 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c152ac8b6a931f116cde430b717181084effd333, data reload: false

query1	0.04	0.04	0.03
query2	0.12	0.11	0.11
query3	0.24	0.20	0.19
query4	1.58	0.20	0.11
query5	0.43	0.43	0.43
query6	1.18	0.66	0.66
query7	0.03	0.02	0.02
query8	0.05	0.03	0.04
query9	0.60	0.55	0.50
query10	0.57	0.57	0.57
query11	0.16	0.11	0.12
query12	0.14	0.11	0.12
query13	0.62	0.59	0.59
query14	0.80	0.81	0.82
query15	0.88	0.85	0.86
query16	0.38	0.39	0.38
query17	1.04	1.05	1.06
query18	0.22	0.22	0.20
query19	1.96	1.74	1.84
query20	0.02	0.01	0.01
query21	15.40	0.94	0.55
query22	0.77	1.23	0.80
query23	14.76	1.40	0.59
query24	7.00	1.45	0.67
query25	0.46	0.19	0.05
query26	0.51	0.17	0.15
query27	0.05	0.05	0.04
query28	9.12	0.92	0.45
query29	12.53	3.96	3.38
query30	0.25	0.10	0.06
query31	2.82	0.60	0.38
query32	3.25	0.55	0.46
query33	3.02	2.99	3.06
query34	15.87	5.11	4.56
query35	4.57	4.58	4.50
query36	0.67	0.49	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.03
query40	0.17	0.14	0.14
query41	0.08	0.03	0.04
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 102.6 s
Total hot run time: 28.95 s

Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label May 30, 2025
Copy link
Contributor

PR approved by anyone and no changes requested.

@starocean999 starocean999 merged commit 078c0e2 into apache:master May 30, 2025
25 of 26 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants