[NoQA] fix: Split up too big output files in E2E performance pipelines #58740

chrispader · 2025-03-19T16:24:14Z

Explanation of Change

Apparently the GitHub CLI doesn't allow posting comments (gh pr comment) through with more than 65536 characters. This PR adds logic for splitting up the output file into multiple files if necessary and posting as individual comments.

Fixed Issues

$ #58715
$ #59002
PROPOSAL:

Tests

Verify that no errors appear in the JS console

Offline tests

QA Steps

// TODO: These must be filled out, or the issue title must include "[No QA]."

Verify that no errors appear in the JS console

PR Author Checklist

I linked the correct issue in the ### Fixed Issues section above
I wrote clear testing steps that cover the changes made in this PR
- I added steps for local testing in the Tests section
- I added steps for the expected offline behavior in the Offline steps section
- I added steps for Staging and/or Production testing in the QA steps section
- I added steps to cover failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
- I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
- I tested this PR with a High Traffic account against the staging or production API to ensure there are no regressions (e.g. long loading states that impact usability).
I included screenshots or videos for tests on all platforms
I ran the tests on all platforms & verified they passed on:
- Android: Native
- Android: mWeb Chrome
- iOS: Native
- iOS: mWeb Safari
- MacOS: Chrome / Safari
- MacOS: Desktop
I verified there are no console errors (if there's a console error not related to the PR, report it or open an issue for it to be fixed)
I followed proper code patterns (see Reviewing the code)
- I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick)
- I verified that comments were added to code that is not self explanatory
- I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
- I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
  - If any non-english text was added/modified, I used JaimeGPT to get English > Spanish translation. I then posted it in #expensify-open-source and it was approved by an internal Expensify engineer. Link to Slack message:
- I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
- I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
- I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
- I verified the JSDocs style guidelines (in STYLE.md) were followed
If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
I followed the guidelines as stated in the Review Guidelines
I tested other components that can be impacted by my changes (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar are working as expected)
I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
I verified any variables that can be defined as constants (ie. in CONST.ts or at the top of the file that uses the constant) are defined as such
I verified that if a function's arguments changed that all usages have also been updated correctly
If any new file was added I verified that:
- The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory
If a new CSS style is added I verified that:
- A similar style doesn't already exist
- The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG))
If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
- I verified that all the inputs inside a form are aligned with each other.
- I added Design label and/or tagged @Expensify/design so the design team can review the changes.
If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
I added unit tests for any new feature or bug fix in this PR to help automatically prevent regressions in this user flow.
If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.

Screenshots/Videos

Android: Native

Android: mWeb Chrome

iOS: Native

iOS: mWeb Safari

MacOS: Chrome / Safari

MacOS: Desktop

melvin-bot · 2025-03-19T16:24:44Z

@techievivek Please copy/paste the Reviewer Checklist from here into a new comment on this PR and complete it. If you have the K2 extension, you can simply click: [this button]

github-actions · 2025-03-19T20:23:40Z

Performance Test Results (Part aa)

Performance Comparison Report 📊

Significant Changes To Duration

Name	Duration
App start time contentAppeared_To_screenTTI	1096.806 ms → 1272.594 ms (+175.789 ms, +16.0%) 🔴

Show details

Name	Duration
App start time contentAppeared_To_screenTTI	Baseline Mean: 1096.806 ms Stdev: 274.885 ms (25.1%) Runs: 578.8639850001782 600.3961780001409 604.1786529999226 634.7332049999386 650.218305000104 651.7110859998502 660.9689270001836 662.4716810001992 664.7883640001528 665.7482259999961 696.7905520000495 701.798225000035 714.5027459999546 717.7380329999141 723.9978649998084 742.4991779997945 749.5199310001917 1067.2606689999811 1093.7439959999174 1122.9983230000362 1159.8428819999099 1172.2096199998632 1176.5981589998119 1180.7201049998403 1208.3453990002163 1213.309249999933 1218.10151100019 1224.869812999852 1230.7505919998512 1235.6954760001972 1240.1834049997851 1240.4823889997788 1251.2629920002073 1254.5064840000123 1255.3923499998637 1272.124452999793 1272.9388489997946 1279.4062950001098 1282.6705350000411 1292.1686370000243 1295.7771990001202 1300.5155839999206 1302.2160740001127 1306.962441000156 1308.3477070000954 1308.8795119998977 1310.8387319999747 1312.8945659999736 1315.2745199999772 1315.7351390002295 1316.6300960001536 1320.6995729999617 1328.2320610000752 1329.5086650000885 1332.7494270000607 1336.1221360000782 1340.0268859998323 1347.8962530000135 1351.825377999805 1360.6948239998892 Current Mean: 1272.594 ms Stdev: 69.224 ms (5.4%) Runs: 1126.717236999888 1143.737685999833 1145.7000870001502 1158.9909859998152 1162.1878749998286 1178.1222569998354 1181.6009700000286 1190.2675689999014 1197.179417999927 1203.0041200001724 1203.5792550002225 1204.1476349998266 1221.40687600011 1227.6039499999024 1240.579735999927 1257.6179789998569 1261.571777000092 1266.5014729998074 1268.1605739998631 1276.2002369998954 1279.1171189998277 1290.6991750001907 1291.8183329999447 1296.8616969999857 1303.4589909999631 1307.031607999932 1307.5671910000965 1308.5582079999149 1309.676520000212 1313.43127800012 1319.5664200000465 1327.5410360000096 1327.8819599999115 1328.0697010001168 1336.7205010000616 1336.822705999948 1341.2282659998164 1341.235925000161 1342.8568819998764 1343.230485000182 1346.301214999985 1350.5527710001916 1357.4829290001653 1368.3259519999847 1375.8218569997698

Meaningless Changes To Duration

Show entries

Name	Duration
App start time nativeLaunchEnd_To_appCreationStart	80.070 ms → 81.053 ms (+0.982 ms, +1.2%)
App start time nativeLaunch	25.617 ms → 25.814 ms (+0.197 ms, +0.8%)
App start time appCreationEnd_To_contentAppeared	476.684 ms → 472.069 ms (-4.615 ms, -1.0%)
App start time appCreation	73.533 ms → 73.068 ms (-0.466 ms, -0.6%)
App start time runJsBundle	328.583 ms → 331.183 ms (+2.600 ms, +0.8%)
App start time regularAppStart	0.020 ms → 0.020 ms (+0.001 ms, +3.1%)
App start time TTI	1761.089 ms → 1824.410 ms (+63.321 ms, +3.6%)
App start time (CPU)	152.317 % → 152.332 % (+0.015 %, ±0.0%)
App start time (FPS)	60.000 FPS → 60.000 FPS
App start time (RAM)	375.758 MB → 374.967 MB (-0.792 MB, ±0.0%)
App start time (CPU/JS)	0.000 % → 0.000 %
App start time (CPU/UI)	27.577 % → 27.607 % (+0.030 %, ±0.0%)
Open search router TTI Open Search Router TTI	1423.431 ms → 1434.896 ms (+11.465 ms, +0.8%)
Open search router TTI Load Search Options	183.854 ms → 180.362 ms (-3.492 ms, -1.9%)
Open search router TTI (CPU)	143.704 % → 144.732 % (+1.028 %, +0.7%)
Open search router TTI (FPS)	60.000 FPS → 60.000 FPS
Open search router TTI (RAM)	386.260 MB → 386.938 MB (+0.677 MB, ±0.0%)
Open search router TTI (CPU/JS)	0.000 % → 0.000 %
Open search router TTI (CPU/UI)	24.002 % → 24.167 % (+0.165 %, +0.7%)
Report typing Composer typing rerender count	1.000 renders → 1.000 renders
Report typing Message sent	434.716 ms → 435.285 ms (+0.568 ms, ±0.0%)
Report typing (CPU)	90.282 % → 90.793 % (+0.511 %, +0.6%)
Report typing (FPS)	60.000 FPS → 60.000 FPS
Report typing (RAM)	447.063 MB → 446.158 MB (-0.905 MB, ±0.0%)
Report typing (CPU/JS)	0.000 % → 0.000 %
Report typing (CPU/UI)	21.142 % → 21.184 % (+0.042 %, ±0.0%)
Chat opening Chat TTI	904.604 ms → 898.601 ms (-6.003 ms, -0.7%)
Chat opening (CPU)	153.988 % → 154.178 % (+0.190 %, ±0.0%)
Chat opening (FPS)	60.000 FPS → 60.000 FPS
Chat opening (RAM)	383.839 MB → 382.737 MB (-1.102 MB, ±0.0%)
Chat opening (CPU/JS)	0.000 % → 0.000 %
Chat opening (CPU/UI)	31.190 % → 31.000 % (-0.190 %, -0.6%)

Show details

Name	Duration
App start time nativeLaunchEnd_To_appCreationStart	Baseline Mean: 80.070 ms Stdev: 8.122 ms (10.1%) Runs: 65 67 67 68 68 68 69 70 70 70 71 71 72 73 73 74 74 74 76 77 77 78 78 78 79 79 80 80 81 82 82 82 84 84 84 84 84 84 84 84 85 85 86 86 87 87 87 88 88 90 90 90 91 92 92 96 99 Current Mean: 81.053 ms Stdev: 9.187 ms (11.3%) Runs: 64 64 64 65 67 67 70 71 72 72 72 73 73 75 75 76 76 76 77 77 78 78 78 79 80 80 80 80 81 81 82 82 82 84 84 84 84 84 84 86 86 86 87 87 88 89 90 90 91 93 93 94 94 97 97 98 103

github-actions · 2025-03-19T20:23:41Z

Performance Test Results (Part ab)

| App start time nativeLaunch | Baseline
Mean: 25.617 ms
Stdev: 2.922 ms (11.4%)
Runs: 21 21 21 22 22 22 22 22 22 23 23 23 23 23 23 23 23 23 24 24 24 24 24 24 24 25 25 25 25 25 25 25 26 26 26 26 27 27 27 27 27 27 28 28 28 28 28 28 28 28 28 29 29 30 30 30 30 31 32 33

Current
Mean: 25.814 ms
Stdev: 3.694 ms (14.3%)
Runs: 21 22 22 22 22 22 22 22 22 22 23 23 23 23 23 23 23 23 23 23 23 23 23 24 24 24 24 24 24 25 25 26 26 26 26 26 26 26 27 27 27 27 27 28 28 28 29 29 29 29 29 31 31 32 32 33 35 35 36 |
| App start time appCreationEnd_To_contentAppeared | Baseline
Mean: 476.684 ms
Stdev: 43.912 ms (9.2%)
Runs: 391 410 411 413 413 414 415 423 423 428 429 433 439 447 452 455 459 460 461 463 466 467 468 468 469 471 471 472 472 472 473 478 479 484 485 485 486 489 493 494 497 497 500 506 507 510 511 512 523 527 529 531 545 567 570 570 588

Current
Mean: 472.069 ms
Stdev: 40.862 ms (8.7%)
Runs: 392 403 408 410 410 413 414 416 417 421 423 424 431 444 444 445 445 447 447 456 457 466 467 467 470 471 471 471 477 479 480 482 483 484 485 485 487 487 493 493 495 496 497 499 501 502 504 505 510 518 518 519 530 532 534 537 543 575 |
| App start time appCreation | Baseline
Mean: 73.533 ms
Stdev: 11.394 ms (15.5%)
Runs: 56 57 59 59 60 60 61 61 62 62 62 63 63 64 64 64 64 64 65 65 66 67 67 69 69 70 70 71 71 72 73 73 74 74 76 76 76 76 77 77 77 78 78 79 80 81 81 82 82 83 85 89 89 89 92 94 95 96 100 103

Current
Mean: 73.068 ms
Stdev: 9.751 ms (13.3%)
Runs: 54 56 56 58 59 59 60 61 62 62 65 66 66 68 68 69 69 69 70 70 70 70 70 70 71 71 71 72 72 72 72 73 73 73 73 74 74 74 75 75 76 76 76 77 79 79 80 80 81 83 84 87 87 88 92 93 93 94 94 |
| App start time runJsBundle | Baseline
Mean: 328.583 ms
Stdev: 24.053 ms (7.3%)
Runs: 278 278 280 280 285 285 285 285 289 289 290 290 295 295 295 295 300 300 301 301 307 307 310 310 311 311 314 314 315 315 315 315 317 317 317 317 319 319 320 320 322 322 322 322 322 322 324 324 324 324 324 324 325 325 325 325 327 327 328 328 328 328 329 329 329 329 330 330 331 331 332 332 333 333 337 337 340 340 341 341 341 341 342 342 346 346 346 346 348 348 348 348 349 349 350 350 350 350 351 351 352 352 353 353 354 354 356 356 358 358 360 360 363 363 373 373 373 373 386 386

Current
Mean: 331.183 ms
Stdev: 25.899 ms (7.8%)
Runs: 279 279 282 282 286 286 286 286 290 290 290 290 294 294 300 300 301 301 303 303 303 303 304 304 309 309 309 309 309 309 312 312 312 312 315 315 319 319 322 322 323 323 324 324 326 326 327 327 328 328 329 329 329 329 329 329 330 330 331 331 332 332 335 335 335 335 336 336 337 337 339 339 339 339 340 340 342 342 343 343 344 344 345 345 346 346 349 349 351 351 353 353 354 354 356 356 357 357 357 357 357 357 358 358 359 359 362 362 365 365 366 366 375 375 376 376 379 379 383 383

github-actions · 2025-03-19T20:23:42Z

Performance Test Results (Part ac)

| App start time regularAppStart | Baseline
Mean: 0.020 ms
Stdev: 0.002 ms (9.4%)
Runs: 0.015868999995291233 0.016682999674230814 0.016927000135183334 0.017130999825894833 0.017374000046402216 0.017577999737113714 0.017780999653041363 0.0177819998934865 0.017903999891132116 0.017903999891132116 0.018269000109285116 0.01859499979764223 0.018635999877005816 0.01867600018158555 0.018838999792933464 0.018838999792933464 0.019084000028669834 0.019164999946951866 0.019164999946951866 0.019204999785870314 0.01920600002631545 0.019409000407904387 0.019450000021606684 0.019530999939888716 0.019611999858170748 0.019611999858170748 0.019652999937534332 0.019694000016897917 0.0197350000962615 0.019897999707609415 0.019898000173270702 0.01993800001218915 0.020018999930471182 0.020182000007480383 0.020426999777555466 0.0204670000821352 0.020507999695837498 0.020507999695837498 0.020589000079780817 0.020792999770492315 0.021076999604701996 0.02111799968406558 0.021239999681711197 0.021484000142663717 0.021525000222027302 0.02164700021967292 0.02168699959293008 0.02201299974694848 0.022298000287264585 0.022420000284910202 0.023111999966204166 0.0233559999614954 0.024618000257760286 0.02469900017604232

Current
Mean: 0.020 ms
Stdev: 0.002 ms (10.3%)
Runs: 0.016600999981164932 0.016846000216901302 0.017090000212192535 0.017659999895840883 0.017822000198066235 0.01794400019571185 0.018106999807059765 0.018635999877005816 0.018757999874651432 0.018757999874651432 0.018798000179231167 0.01887999987229705 0.018880000337958336 0.01896099979057908 0.019001999869942665 0.019001999869942665 0.01912400033324957 0.019164999946951866 0.01920600002631545 0.019245999865233898 0.01928700041025877 0.0194089999422431 0.019450000021606684 0.0195720000192523 0.019857000093907118 0.019857000093907118 0.019896999932825565 0.019898000173270702 0.020018999930471182 0.02002000017091632 0.02010100008919835 0.020223000086843967 0.020262999925762415 0.0206300001591444 0.02066999999806285 0.020711999852210283 0.020873999688774347 0.020913999993354082 0.021077000070363283 0.021077999845147133 0.021484999917447567 0.021769000217318535 0.021890999749302864 0.02189100021496415 0.02193199982866645 0.022135000210255384 0.022135999985039234 0.022135999985039234 0.022500999737530947 0.022624000441282988 0.022909000050276518 0.023111999966204166 0.023763000033795834 0.024292000103741884 0.024577000178396702 0.025268999859690666 0.025511999614536762 0.025553999934345484 |
| App start time TTI | Baseline
Mean: 1761.089 ms
Stdev: 293.404 ms (16.7%)
Runs: 1167.1786529999226 1199.7332049999386 1220.396178000141 1259.7883640001528 1272.7905520000495 1292.7110859998502 1311.218305000104 1316.4716810001992 1330.8639850001782 1332.9689270001836 1348.5027459999546 1355.748225999996 1357.7380329999141 1360.798225000035 1398.5199310001917 1403.9978649998084 1433.4991779997945 1668.2606689999811 1741.8428819999099 1783.7439959999174 1803.9983230000362 1805.3453990002163 1812.10151100019 1820.869812999852 1850.124452999793 1853.2096199998632 1854.5064840000123 1854.6954760001972 1862.3923499998637 1892.2629920002073 1896.962441000156 1932.7201049998403 1933.2160740001127 1935.9388489997946 1937.5155839999206 1948.6705350000411 1949.4062950001098 1960.309249999933 1966.8795119998977 1968.2745199999772 1974.7505919998512 1980.3477070000954 1980.7771990001202 1983.6995729999617 1988.1686370000243 1993.7494270000607 2001.1834049997851 2001.7351390002295 2004.1221360000782 2004.6300960001536 2012.5981589998119 2013.0268859998323 2018.8962530000135 2022.6948239998892 2032.8387319999747 2039.2320610000752 2042.4823889997788 2049.825377999805 2057.5086650000885 2066.8945659999736

Current
Mean: 1824.410 ms
Stdev: 245.750 ms (13.5%)
Runs: 1318.1406600000337 1322.261208999902 1323.914084999822 1324.2389409998432 1351.2189899999648 1355.4236869998276 1372.9435069998726 1388.4841479999013 1397.4344159998 1410.5868210000917 1422.5797990001738 1708.717236999888 1748.1878749998286 1752.1222569998354 1754.7000870001502 1781.6009700000286 1795.1476349998266 1798.5792550002225 1817.0041200001724 1845.737685999833 1849.5014729998074 1851.179417999927 1855.579735999927 1862.1171189998277 1864.9909859998152 1900.6991750001907 1918.1605739998631 1937.676520000212 1943.2002369998954 1945.5582079999149 1946.571777000092 1947.6179789998569 1952.8183329999447 1961.8568819998764 1980.8616969999857 1982.301214999985 1986.0697010001168 1992.8819599999115 1995.822705999948 1996.6039499999024 1997.5671910000965 1999.40687600011 2005.4589909999631 2012.031607999932 2018.5410360000096 2019.230485000182 2019.4829290001653 2022.43127800012 2028.235925000161 2031.2282659998164 2041.5664200000465 2043.7205010000616 2045.5527710001916 2060.82185699977 2072.3259519999847 2088.2675689999014 |
| App start time (CPU) | Baseline
Mean: 152.317 %
Stdev: 7.122 % (4.7%)
Runs: 135.49847343352988 140.34518611555262 140.4326279995644 143.21947049958382 143.65941752097734 144.1148964595858 144.1161932105349 144.26068837476154 144.4235966115424 144.53632417704276 145.12322458894198 145.25245324010146 145.72949658371604 145.98631994527986 146.8319159142025 146.9146844901622 146.94465798240893 147.18693680233213 147.2795568858574 147.46609263322694 147.66047929026058 147.69612509635698 147.75140876574116 149.00051194742406 149.22378770853152 149.92034711597734 150.2037625247367 150.72324041340974 151.79099452275705 152.05644824837512 152.90340226396012 152.9747073901165 153.333324203744 153.62213384346964 153.78446199419207 155.78563208089813 155.78904610238294 155.81699743728268 155.93583912297362 156.9123122454175 157.234132249476 157.2384196510784 157.31301667521112 157.34808336946077 157.6042974350032 157.75156452526525 157.88644729120034 157.97803088772997 158.27076838243087 158.28582728512495 158.78222687043169 160.68843667268862 161.57217348264115 162.53655264922872 163.47173767476608 163.5017203814604 163.64824474579453 164.13416295748812 165.03256881475383 166.52750276339762

Current
Mean: 152.332 %
Stdev: 6.814 % (4.5%)
Runs: 135.74619684932918 136.42659067243935 141.7271355669349 142.00239690597562 142.57303301275192 143.08903808148537 143.40691462104212 143.8337686600067 144.50563399535218 144.5662923585081 145.1048261743797 145.98646862395364 146.90122461242393 147.37391340939126 147.4277519181791 148.40828170599565 148.84706019567767 148.90116092390886 149.01106627143653 149.04388946452576 149.5923322483796 149.80721450945313 149.9238944403309 150.3007692595419 151.0104530076456 151.2599171646628 151.95927719004635 151.97417119458225 152.17950030215968 152.26921343285727 152.5311645936613 152.8158165011982 152.8650835644977 152.88856800978633 153.28480159814475 153.3264432938448 154.7581686375264 154.8302064577437 154.87234373892758 155.92796331635597 156.37085408678948 156.43760289709363 156.80176367537356 156.89583042811324 156.95949208970967 157.4012865509015 157.73313699656407 158.41241375441385 158.5228466508622 159.28664720416944 159.4699048118901 159.56081054308288 159.87919705734407 160.16551048877912 161.40122948222321 163.72281708157684 164.05991066891332 164.36356003873323 164.37344282557478 164.83666199741015 |
| App start time (FPS) | Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

github-actions · 2025-03-19T20:23:42Z

Performance Test Results (Part ad)

| App start time (RAM) | Baseline
Mean: 375.758 MB
Stdev: 5.168 MB (1.4%)
Runs: 363.0286458333333 365.8216145833333 367.15625 368.1497395833333 368.248046875 368.3330078125 368.6328125 368.796875 369.3841145833333 370.5950520833333 371.150390625 371.7708333333333 371.8177083333333 372.0520833333333 372.0546875 372.3059895833333 372.4205729166667 372.6787109375 372.9970703125 373.0611979166667 373.5247395833333 373.7252604166667 373.9010416666667 374.71484375 374.7682291666667 374.94921875 375.1953125 375.3528645833333 375.4895833333333 375.5833333333333 375.7317708333333 376.16796875 376.5260416666667 376.8671875 376.90234375 377.31640625 377.41796875 377.859375 377.9466145833333 378.0221354166667 378.3424479166667 378.7421875 378.744140625 379.03125 379.55078125 379.5556640625 379.8642578125 380.4697265625 380.5481770833333 380.796875 381.02734375 381.0849609375 381.2451171875 381.59375 382.029296875 382.544921875 382.701171875 383.689453125 385.572265625 389.9440104166667

Current
Mean: 374.967 MB
Stdev: 5.333 MB (1.4%)
Runs: 361.7174479166667 364.626953125 364.69140625 364.7421875 365.7057291666667 366.6171875 366.9912109375 367.0009765625 369.486328125 369.548828125 369.6041666666667 369.828125 370.1354166666667 370.5065104166667 370.830078125 371.78515625 372.79296875 373.01171875 373.2666015625 373.40625 373.4934895833333 373.640625 373.6510416666667 373.8046875 374.20703125 374.2408854166667 374.8307291666667 374.9049479166667 376.046875 376.7291666666667 376.7607421875 376.7861328125 376.796875 376.9091796875 376.9544270833333 377.34765625 377.40625 377.41015625 377.533203125 377.6419270833333 377.8502604166667 378.25 378.57421875 378.7513020833333 379.1796875 379.4453125 379.673828125 379.796875 379.9931640625 380.154296875 380.8984375 381.0478515625 381.0872395833333 381.140625 381.30859375 381.3994140625 382.3994140625 383.9140625 384.77734375 |
| App start time (CPU/JS) | Baseline
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

Current
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 |
| App start time (CPU/UI) | Baseline
Mean: 27.577 %
Stdev: 2.769 % (10.0%)
Runs: 22.1 22.6 23.2 23.4 23.9 24 24 24.1 24.5 24.6 24.6 24.6 24.7 24.9 25.4 25.4 25.4 25.4 25.7 25.7 25.7 26 26.4 26.6 26.7 27 27.2 27.3 27.4 27.5 27.7 27.8 28.1 28.3 28.3 28.5 28.5 28.5 29 29.4 29.5 29.5 29.8 29.9 29.9 29.9 29.9 30 30.3 30.4 30.5 30.5 30.6 30.7 31.1 31.9 31.9 32.5 32.6 33.1

Current
Mean: 27.607 %
Stdev: 2.553 % (9.2%)
Runs: 22.4 22.6 23.3 23.3 23.3 24 24.1 24.5 24.7 25 25.3 25.3 25.6 25.9 25.9 26 26 26.1 26.5 26.5 26.6 26.6 26.8 27 27 27.1 27.3 27.4 27.4 27.5 27.5 27.5 27.8 28.2 28.4 28.5 28.5 28.5 28.5 28.8 28.9 29 29 29 29 29.1 29.1 29.7 29.9 29.9 30 30.3 30.4 30.6 30.6 31.2 32 32.6 33.2 33.7

github-actions · 2025-03-19T20:23:43Z

Performance Test Results (Part ae)

| Open search router TTI Open Search Router TTI | Baseline
Mean: 1423.431 ms
Stdev: 80.492 ms (5.7%)
Runs: 1228.7577309999615 1228.924682999961 1229.1656100000255 1229.9055590000935 1232.7647299999371 1232.957764999941 1237.2143149999902 1237.5639650002122 1237.6061200001277 1239.756674000062 1240.4919039998204 1241.212199000176 1244.292522000149 1245.2897550002672 1245.385377000086 1245.573080000002 1246.1809489997104 1247.0015869997442 1250.6892099999823 1251.255371000152 1255.6366380001418 1255.8928229999729 1258.6959239998832 1262.1954759997316 1264.160116000101 1264.890625 1265.7619630000554 1266.2186700003222 1266.4381930003874 1267.4191490001976 1267.9668379998766 1268.0897630001418 1268.784587000031 1270.8615729999729 1270.979330000002 1271.6112879998982 1274.1445730002597 1274.5206299996935 1275.0653089997359 1280.009155999869 1280.8335380000062 1282.6491709998809 1283.292156000156 1284.3570969998837 1294.886719999835 1296.0012619998306 1299.0729580000043 1299.223755999934 1300.8644610000774 1301.478964000009 1301.9794120001607 1302.8628340000287 1303.140788000077 1304.1896159998141 1309.610393000301 1311.6408290001564 1312.8315429999493 1315.6108000003733 1315.7518720002845 1319.5489509999752 1321.0606689997949 1321.0986740002409 1327.821372000035 1327.990275000222 1330.159547000192 1331.5550949997269 1333.028849999886 1334.7021079999395 1336.307781000156 1336.6665849997662 1341.1237800000235 1342.6626789998263 1342.7441010000184 1343.2483330001123 1345.8780120001175 1345.9060060000047 1346.295003999956 1346.9115809998475 1347.9722910001874 1348.3534760000184 1350.5137530001812 1354.822714000009 1356.079590999987 1356.9625249998644 1357.3764650002122 1358.6656909999438 1358.8717050002888 1359.1713470001705 1360.6232509999536 1363.6969820000231 1364.1619070000015 1364.1619070000015 1365.5780440000817 1366.883261000272 1368.5781670003198 1368.7275400003418 1369.8873299998231 1370.3482260000892 1370.5988779999316 1370.9521900000982 1371.7591160000302 1372.0479339999147 1372.5359300002456 1374.369752000086 1375.0797530002892 1375.0797530002892 1375.8956710002385 1378.3771170000546 1378.700724999886 1381.6702479999512 1381.6702479999512 1383.5321049997583 1383.9541020002216 1384.661621000152 1386.6676040003076 1386.9604500001296 1387.4555270001292 1388.3004979998805 1388.9722090000287 1389.1001389999874 1389.1001389999874 1389.1387940002605 1389.1387940002605 1390.5602220003493 1391.6418469999917 1391.7764079999179 1391.9017340000719 1392.1781419999897 1392.1781419999897 1392.5069590001367 1392.5640879999846 1392.9183769999072 1394.0794270001352 1394.3780519999564 1394.643106999807 1395.399333000183 1395.6711019999348 1396.954590999987 1397.6026210002601 1398.6348069999367 1399.2935390002094 1399.670167000033 1400.2724619996734 1400.719199000392 1401.3944500000216 1401.3944500000216 1402.02970500011 1402.3738609999418 1402.4957280000672 1402.5138759999536 1403.8814300000668 1404.038371000439 1404.7250569998287 1404.8878580001183 1405.9579680003226 1406.1595060001127 1406.406210000161 1406.704143000301 1407.089397000149 1407.089397000149 1407.427044000011 1407.5587169998325 1407.9987389999442 1408.2601729999296 1408.7174490001053 1409.4326579999179 1409.4326579999179 1410.1313889999874 1410.153483999893 1410.81148400018 1411.662394999992 1412.4916600002907 1414.0360119999386 1415.0391850001179 1415.0640459996648 1415.0640459996648 1415.0825609997846 1416.4788830000907 1417.9742030003108 1418.116781000048 1418.309449000284 1418.309449000284 1419.469971000217 1420.516235999763 1420.9635830000043 1421.0770680001006 1421.6717130001634 1422.2957359999418 1422.2957359999418 1423.9956869999878 1424.6579999998212 1425.0577400000766 1425.6074629998766 1426.445679999888 1426.4674490001053 1426.6237389999442 1426.7620450002141 1426.9857999999076 1427.2789320000447 1427.391764999833 1427.8877779999748 1428.3931080000475 1428.659260999877 1429.0369879999198 1429.3692220002413 1429.62162300013 1429.7880460000597 1430.8618990001269 1430.8690190003254 1431.6040860000066 1432.50362199964 1432.50362199964 1432.5223390003666 1432.7441010000184 1432.7441010000184 1432.861370000057 1433.5339359999634 1433.7806400000118 1434.8197439997457 1434.9304619999602 1434.9304619999602 1435.0648199999705 1435.0648199999705 1435.697714000009 1436.1304540000856 1436.2370620002039 1436.8497729999945 1436.8649510000832 1437.2243659999222 1437.4058030000888 1437.6493739997968 1438.3118900000118 1438.44974800013 1438.44974800013 1439.2656259997748 1439.4841320002452 1439.6667889999226 1439.6667889999226 1440.4996750000864 1440.7082530003972 1440.7690849998035 1441.28125 1441.8870859998278 1441.8883869997226 1441.8883869997226 1442.2781170001253 1442.3336999998428 1442.3336999998428 1442.382853999734 1443.995647000149 1444.2744559999555 1444.7669689999893 1445.2400310002267 1446.0008149999194 1446.5218110000715 1447.022299000062 1447.1257740003057 1447.3049729997292 1447.6143800001591 1447.6543790004216 1448.2578540001996 1449.0401620003395 1449.145630999934 1449.145630999934 1449.4411220001057 1449.4411220001057 1449.4544689999893 1449.5781660000794 1449.7931320001371 1450.616333999671 1450.8448900002986 1451.0131029998884 1451.238933000248 1451.4311529998668 1451.9467369997874 1452.3661299999803 1453.2969979997724 1453.4189869998954 1453.5111090000719 1453.9271249999292 1454.4900320000015 1455.4679370000958 1455.7491060001776 1457.4193120002747 1458.8145360001363 1459.1087250001729 1459.1087250001729 1459.1333010001108 1459.3206790001132 1459.429241000209 1459.429241000209 1459.7873140000738 1460.9072679998353 1460.9413259997964 1461.4867759998888 1462.0024419999681 1462.1174729997292 1462.1174729997292 1462.1958019998856 1462.8388279997744 1463.2145589999855 1463.23046900006 1463.2468669996597 1464.237346000038 1465.2277020001784 1465.2277020001784 1466.4057620000094 1466.8155530001968 1466.9541029999964 1468.5529789999127 1469.015951000154 1470.5025240001269 1471.2835699999705 1471.4406339996494 1471.8436700003222 1472.185018000193 1472.472779000178 1472.5348320002668 1472.5717780003324 1474.1433520000428 1474.4170339996926 1474.4170339996926 1474.439168999903 1475.1775719998404 1476.3839119998738 1476.6706150001846 1476.7510990002193 1477.9962169998325 1478.1865249997936 1478.781820999924 1479.2860519997776 1480.1635340000503 1481.7373869996518 1482.0679119997658 1482.3152270000428 1482.4524750001729 1482.4842540002428 1482.6398109998554 1483.1416429998353 1484.0494389999658 1484.5555430003442 1484.9358319998719 1484.9358319998719 1486.9945080000907 1487.4075939999893 1488.0176599998958 1488.2231459999457 1488.2231459999457 1488.2769379997626 1488.6150310002267 1489.7869070000015 1489.7869070000015 1491.1458340003155 1491.6673590000719 1491.9629319999367 1492.076214000117 1493.1125089996494 1493.8357350002043 1493.986370000057 1494.2967940000817 1494.578695999924 1494.728313000407 1494.728313000407 1494.7956139999442 1494.8599049998447 1494.8599049998447 1495.714844999835 1496.3975029997528 1496.5891120000742 1496.8215749999508 1497.4553630002774 1499.3306489996612 1499.475750000216 1499.8575849998742 1499.988730000332 1500.735311999917 1501.022828000132 1501.8470469997264 1502.261555999983 1503.3419199995697 1503.504110999871 1503.816487999633 1503.816487999633 1504.8064379999414 1506.1861990001053 1506.3136809999123 1507.6411950001493 1508.502971000038 1508.502971000038 1509.2471940000542 1510.2466640002094 1510.4620779999532 1510.544637999963 1510.665771999862 1511.168171999976 1512.2843430000357 1512.4009610000066 1512.7674969998188 1513.0684420000762 1513.3087169998325 1513.6122650001198 1516.791627000086 1517.9241949999705 1517.9241949999705 1518.0775560000911 1518.0795089998282 1518.3179530003108 1518.3430590000935 1518.4519050000235 1520.371581999585 1522.5057789999992 1523.2275800001808 1523.5136730000377 1524.6883549997583 1524.9316420000978 1526.805217999965 1526.9803069997579 1528.332846000325 1530.593384000007 1531.25183199998 1532.9093430000357 1533.2593600000255 1534.998494999949 1535.216878999956 1537.073569000233 1538.64168300014 1539.2200939999893 1539.2200939999893 1539.2958180001006 1539.3866389999166 1540.2205000002868 1540.7136639999226 1540.7136639999226 1542.956909999717 1542.9673669999465 1543.6158449999057 1544.6540120001882 1546.3068849998526 1548.1713470001705 1551.2545579997823 1553.8464770000428 1555.4680590000935 1558.02917600004 1559.4525150000118 1560.6120609999634 1565.1667889999226 1568.1463219998404 1571.366415000055 1584.5622560000047

Current
Mean: 1434.896 ms
Stdev: 108.197 ms (7.5%)
Runs: 1175.0432540001348 1176.822387999855 1182.6851409999654 1184.384887999855 1184.4242759998888 1186.195069000125 1188.9083259999752 1197.525920000393 1198.5726729999296 1200.3579919999465 1206.382569000125 1215.0899660000578 1215.3042400004342 1220.8362630000338 1222.124634000007 1228.2675789999776 1228.5442309998907 1230.947916999925 1234.9758310001343 1237.8453370002098 1240.5774750001729 1241.7220869995654 1242.404215999879 1245.2664399999194 1245.4533290001564 1247.2099609998986 1249.595379000064 1253.6028249999508 1255.4938160004094 1257.251995000057 1257.5850430000573 1258.5491539998911 1259.183594999835 1259.6995450002141 1262.9208579999395 1268.0800380003639 1272.4850269998424 1275.089152999688 1275.8429780001752 1276.1848960001953 1278.203288000077 1279.9429930001497 1281.0644539999776 1282.700235999655 1292.132079999894 1292.7926839999855 1295.6495770001784 1295.664511000272 1297.963339000009 1301.0027670003474 1301.1428229999729 1301.6434740000404 1302.7024739999324 1304.4285079999827 1309.4526379997842 1311.1691080001183 1315.4798179999925 1317.0808520000428 1320.3999029998668 1320.5622560000047 1321.6940510002896 1322.4157310002483 1323.8084720000625 1326.098145000171 1326.3610849999823 1327.5677499999292 1327.5677499999292 1330.454630999826 1330.7729500001296 1332.507242999971 1333.8174640000798 1338.856690000277 1338.965699000284 1340.50415099971 1341.0544030000456 1341.731161000207 1342.7790119997226 1345.4743659999222 1345.6217049998231 1346.8101409999654 1348.683147000149 1349.3586840000935 1349.984172000084 1350.6715910001658 1353.091349999886 1354.5909429998137 1356.435994999949 1356.760377000086 1358.157105000224 1358.5454919999465 1361.022583999671 1362.6360679999925 1363.4900719998404 1364.4152440000325 1364.7484540003352 1366.0564379999414 1366.0564379999414 1366.3184410003014 1366.3184410003014 1366.9032389996573 1367.1117759998888 1367.2831629998982 1368.0906580002047 1368.0906580002047 1369.0338139999658 1370.3784999996424 1372.5051279999316 1373.2256679995917 1373.5241709998809 1373.9561780001968 1374.2193200001493 1374.2193200001493 1374.6899419999681 1374.6899419999681 1375.15808199998 1375.341594000347 1375.341594000347 1377.5391040001996 1379.2080899998546 1379.4738369998522 1380.3851330000907 1381.401815999765 1381.401815999765 1381.4133309996687 1381.9119060002267 1382.1995450002141 1382.713175999932 1383.2500410000794 1384.9158940003254 1385.2113450001925 1385.6562910000794 1386.0679939999245 1386.179281000048 1386.5251879999414 1386.750326000154 1387.7898769997992 1388.3554289997555 1389.2773040002212 1389.8931070002727 1390.1861169999465 1390.1861169999465 1390.8440359998494 1391.4428309998475 1391.5144870001823 1391.6969809997827 1392.6477870000526 1393.0769050000235 1393.4496259996668 1393.6562099996954 1393.7701420001686 1394.3922529998235 1395.9014489999972 1396.0828859996982 1396.85599800013 1396.85599800013 1397.073243000079 1397.3026539999992 1397.3026539999992 1397.7574470001273 1398.079509000294 1398.5033779996447 1398.5033779996447 1398.5314540001564 1398.7471110001206 1398.8453379999846 1399.6716729998589 1400.8660079999827 1401.1293140002526 1401.5847169999033 1401.597087000031 1401.7213540002704 1402.9344089999795 1403.54817799991 1403.54817799991 1403.6405449998565 1403.7666429998353 1405.6713060000911 1405.7666839999147 1406.0368659999222 1406.0368659999222 1406.1251229997724 1406.306762999855 1407.7189939999953 1407.7192800003104 1408.5218110000715 1408.7904460001737 1409.853882999625 1410.1037200000137 1410.7759610000066 1411.779623000417 1413.6667479998432 1413.9630539999343 1414.5547690000385 1414.7311209999025 1414.735230000224 1415.722168999724 1415.722168999724 1417.0233160001226 1417.2637940002605 1417.794353000354 1417.9086110000499 1418.463215999771 1418.9455570001155 1419.2677829996683 1419.36120699998 1420.1830250001512 1420.4939779997803 1420.7076429999433 1423.2420660001226 1423.324219999835 1424.584962000139 1425.5332849998958 1426.234824000392 1426.432902999688 1426.5928560001776 1426.682128999848 1426.8495690003037 1426.8495690003037 1426.9705809997395 1427.0237230001949 1427.3529469999485 1427.4901950000785 1428.7855229997076 1429.3350840001367 1429.5790200000629 1430.8278820002452 1430.8278820002452 1431.447795000393 1431.561321000103 1432.0898850001395 1434.2225339999422 1434.313152000308 1435.6683769999072 1436.7416590000503 1436.8590910001658 1437.459146999754 1437.459146999754 1438.163005000446 1438.6008709999733 1438.7622079998255 1438.7622079998255 1439.1277269995771 1439.183310000226 1439.6934410003014 1441.1362310000695 1441.4807950002141 1442.9761570002884 1444.8525810004212 1445.0416259998456 1445.0416259998456 1445.8698740000837 1447.7382820001803 1447.7382820001803 1447.7688810001127 1448.1342780003324 1448.1407889998518 1448.1618659999222 1448.7986659999005 1449.0147710000165 1449.909750000108 1449.9298510001972 1449.9298510001972 1450.2489829999395 1450.2489829999395 1451.7620849995874 1451.7620849995874 1451.9323330000043 1451.9323330000043 1453.079793999903 1453.366538000293 1453.7370609999634 1454.4917820002884 1455.6139739998616 1456.5970060001127 1456.9769700001925 1458.123494999949 1459.3773200004362 1460.418945999816 1460.7757979999296 1461.0987140000798 1462.7055669999681 1463.481445999816 1463.7061769999564 1464.1246759998612 1464.1528739999048 1464.3457030002028 1464.5261640003882 1465.0638020001352 1465.3770349998958 1465.5152999996208 1467.4583749999292 1469.5711680003442 1470.021972999908 1470.5247410000302 1471.9283449999057 1472.3653170000762 1472.569703000132 1472.8890390000306 1473.2123619997874 1473.671998000238 1473.803222999908 1474.066366000101 1474.2674969998188 1476.2241620002314 1476.408245000057 1477.2982999999076 1477.521972999908 1479.4383559999987 1479.5146490000188 1480.1201579999179 1481.7959399996325 1483.6722820000723 1483.6722820000723 1484.0765790003352 1484.2707120003179 1486.8043219996616 1488.433430999983 1488.4389249999076 1488.5128590003587 1490.1711430000141 1490.4185389997438 1490.5115570002235 1490.6750500001945 1491.28023400018 1492.4553229999729 1492.4553229999729 1494.4533290001564 1494.7290860000066 1495.9849449996836 1496.6788329998963 1497.4047860000283 1498.5744230002165 1498.9981700000353 1499.2220060001127 1499.2859300002456 1501.0970880002715 1502.7384039997123 1502.9883639998734 1503.383261000272 1504.4294850002043 1505.9643149999902 1506.9042569999583 1507.2182620000094 1507.8406989998184 1507.8997410000302 1509.8844819995575 1510.2150889998302 1510.540161000099 1510.540161000099 1510.79195300024 1512.6559249996208 1513.047567000147 1514.8131110002287 1516.2148859999143 1517.0770280002616 1518.3683680002578 1518.3683680002578 1518.5568039999343 1518.8116060001776 1521.3499350002967 1523.7448340002447 1524.1980809997767 1524.7639979999512 1526.0190849998035 1527.2515879999846 1531.1512870001607 1531.3095309999771 1531.7637950000353 1532.0960709997453 1532.3464359999634 1533.0229090000503 1534.2246920000762 1537.6292729997076 1539.2347009996884 1539.726442000363 1543.897338999901 1543.9483650000766 1544.740519999992 1545.4104010001756 1547.2839770000428 1547.7859709998593 1548.2245289999992 1549.31433199998 1552.2596029997803 1556.2218440002762 1556.9602060001343 1557.0559899997897 1557.1171470000409 1558.4767670002766 1558.4767670002766 1559.1082370001823 1559.1082370001823 1559.841025000438 1559.841025000438 1560.3141279998235 1560.4406749997288 1564.7263200003654 1570.0801599998958 1572.5100920000114 1573.1476239999756 1574.2149670002982 1576.4619959997945 1576.5666100000963 1576.7007659999654 1576.7007659999654 1577.329143000301 1579.6154790003784 1581.2287200000137 1581.2892260001972 1589.2213950003497 1590.4340830002911 1591.482340999879 1593.4346119998954 1593.6138520003296 1600.9627700001001 1601.7366949999705 1601.7366949999705 1601.9142670002766 1604.910726999864 1612.9368090000935 1619.5837410003878 1619.6411549998447 1621.099894999992 1621.2033290001564 1621.356608999893 1625.463868000079 1627.2033700002357 1631.5541190002114 1632.4469820000231 1641.2690840000287 1643.3889580001123 1644.673259999603 1651.9356700000353 1654.3071699999273 1659.3946130000986 1661.585857000202 1663.4958500000648 1671.56665099971 1673.035889999941 1675.9729829998687 1681.5775150000118 1683.0468760002404 1683.0782889998518 1684.9044599998742 1694.1095799999312 1701.8738609999418 1706.2692879997194 1709.8996180002578 |
| Open search router TTI Load Search Options | Baseline
Mean: 183.854 ms
Stdev: 6.180 ms (3.4%)
Runs: 169.15486699994653 169.9704990000464 170.9048659997061 171.4021809999831 171.8232419998385 174.55635599978268 175.68851800030097 175.7422690000385 177.0788169996813 177.34423799999058 178.34285500040278 178.52022399986163 178.6875 179.7979330001399 180.57124800002202 181.24072299990803 181.93729700008407 181.95385800022632 182.56477899989113 182.78963299980387 182.87471499992535 182.9925130000338 183.02742600021884 183.0478929998353 183.2119549997151 183.25292999995872 183.36189799988642 183.7952890000306 184.32100400002673 184.55822800006717 185.61210099980235 185.75126200029626 185.76774100027978 185.77742600021884 185.9246020000428 186.06665000040084 186.7376299998723 187.22692900011316 187.35856200009584 187.49182199966162 187.77640800038353 187.88814300019294 187.950398999732 188.25980599969625 188.61124600004405 188.8551029996015 189.11966999992728 189.42439799988642 189.66353400005028 189.73640999989584 189.89591499976814 190.1014809999615 191.1392420004122 192.43379699997604 192.4603270003572 192.83329300023615 194.19250500015914 194.93241399992257

Current
Mean: 180.362 ms
Stdev: 6.178 ms (3.4%)
Runs: 167.75386600010097 168.5175379998982 169.29882899997756 171.85892800008878 172.19938199967146 172.49047899991274 172.6290690000169 173.34700500033796 173.396199000068 173.5614010002464 173.66255699982867 174.27356000011787 174.41109200008214 174.6918529998511 174.69405099982396 174.92155000008643 175.28674300014973 175.7148440000601 175.90909900004044 176.57112600002438 177.27400800026953 177.39831499988213 177.59570300020278 178.51314299972728 178.85660800011829 179.31278500007465 179.49434400023893 179.58976199990138 179.8242190000601 180.15633200015873 180.24743700027466 180.35941600007936 180.6104330001399 180.63305599987507 181.09944699984044 181.50187199981883 181.7146809999831 184.7112630000338 184.71195500018075 184.87040199991316 185.25048799999058 185.45515999989584 185.6252439999953 185.65124499984086 185.78210500022396 185.8504229998216 186.11930399993435 186.30061799986288 186.49365200009197 186.5305989999324 187.0049239997752 187.16666699992493 187.42118299985304 187.76037599984556 188.19694000016898 188.57645700033754 188.57653799979016 189.55224699992687 191.5271809999831 193.20410199975595 |
| Open search router TTI (CPU) | Baseline
Mean: 143.704 %
Stdev: 3.331 % (2.3%)
Runs: 136.526674316596 138.46512614006227 138.8132491640909 139.19226668916704 139.40494593223906 139.40573474645674 139.61395603319033 139.70158740821057 139.97000438130613 140.13153847572372 140.16657539322085 140.22870595638494 140.49158672359448 140.8810022507755 141.2184966095279 141.3904977035373 141.47543720039045 141.90304852781045 142.04635910659303 142.08379767288926 142.10129978046066 142.10549197918496 142.52003068964018 142.8132133756667 142.92647037218808 142.99051592104405 143.0845960482647 143.43559365047557 143.64800517369397 143.7388535581805 143.73946669318724 143.8049880103581 143.8279510307105 144.10521601261703 144.15285372231344 144.39202810970843 144.41223617469583 144.6197584656073 144.6358098819306 144.77558829991543 144.9379545865975 145.114471487707 145.12744257441827 145.7789293390599 146.17245950451775 146.5776175922582 146.64949716632304 146.80512502570906 147.13633891139122 147.51177249414906 147.59499913981986 147.65760603096345 148.1235028499099 148.31465389953382 148.43244286758247 148.70292388732855 149.5898312867011 150.26343260836623 153.11163743974237

Current
Mean: 144.732 %
Stdev: 3.142 % (2.2%)
Runs: 137.87866550859238 139.62352654263074 139.71307377126007 140.24060545594628 140.59420175580237 140.91271184479805 141.2365601062404 141.35255386296032 141.484449424259 141.64526055663566 141.90700764864042 142.09008571488084 142.13459399446424 142.19460261839646 142.28548745948848 142.3864338817736 142.41297549545135 142.51097436174794 142.52566514167128 143.0853490093567 143.3046455386038 143.75515635395882 143.7631845537876 143.94484036491914 144.01253647995568 144.04599814063363 144.08649367930815 144.2888355743114 144.35032767899622 144.45696139587892 144.59156027859171 144.76299542358902 145.23132590830872 145.2777079648375 145.36715669715105 145.41463424730267 145.42057611180357 145.66001692942868 145.68153443236662 145.9433565310756 145.97617055554062 146.12328459976055 146.27972725531643 146.30432097145132 146.4336586618973 146.48786117582873 146.7283041303864 146.84265542470266 147.08948657250698 147.41233642794322 148.43093071318484 148.8747542848419 148.91007982004106 149.9992147865472 150.24494435549113 150.72181873341214 150.78956330617618 151.88908699947504 152.0721295748523 |
| Open search router TTI (FPS) | Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

github-actions · 2025-03-19T20:23:44Z

Performance Test Results (Part af)

| Open search router TTI (RAM) | Baseline
Mean: 386.260 MB
Stdev: 3.215 MB (0.8%)
Runs: 379.5377604166667 379.9515625 380.59609375 380.8072916666667 381.076171875 381.822265625 382.1614583333333 382.7506510416667 382.8098958333333 382.888671875 382.9720052083333 383.0149739583333 383.1529947916667 383.5201822916667 383.958984375 384.2610677083333 384.275 384.44921875 384.5421875 384.8365885416667 384.8411458333333 385.3346354166667 385.666015625 385.6829427083333 385.6927083333333 385.6940104166667 385.7486979166667 385.7897135416667 386.3098958333333 386.453125 387.1022135416667 387.12109375 387.1217447916667 387.1236979166667 387.1946614583333 387.2916666666667 387.5442708333333 388.0065104166667 388.248046875 388.2545572916667 388.375 388.4381510416667 388.525390625 388.53125 388.5963541666667 388.6373697916667 388.853515625 389.1966145833333 389.4251302083333 389.4518229166667 389.7796875 389.7955729166667 390.4296875 390.7434895833333 390.81953125 392.0852864583333 392.6458333333333 393.16015625

Current
Mean: 386.938 MB
Stdev: 3.578 MB (0.9%)
Runs: 379.2734375 379.3671875 380.486328125 380.9466145833333 381.1985677083333 381.7591145833333 382.017578125 382.44921875 383.2278645833333 383.3561197916667 383.716796875 383.7727864583333 383.8203125 383.93203125 384.0358072916667 384.3639322916667 384.7766927083333 384.9088541666667 385.0625 385.3079427083333 385.4095052083333 385.443359375 385.447265625 385.82734375 385.94921875 386.4928385416667 386.5520833333333 386.755859375 387.1731770833333 387.2532552083333 387.33203125 387.4427083333333 387.525390625 387.6647135416667 388.1061197916667 388.158203125 388.1848958333333 388.2688802083333 388.3997395833333 388.5169270833333 388.65234375 388.984375 389.3717447916667 389.71484375 389.845703125 389.8841145833333 389.9244791666667 390.0403645833333 390.0865885416667 390.087890625 390.6223958333333 390.8828125 391.3776041666667 391.4921875 391.5240885416667 391.66796875 391.7356770833333 392.0677083333333 392.5735677083333 396.0338541666667 |
| Open search router TTI (CPU/JS) | Baseline
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

Current
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 |
| Open search router TTI (CPU/UI) | Baseline
Mean: 24.002 %
Stdev: 1.055 % (4.4%)
Runs: 21.8 21.9 22.2 22.3 22.5 22.5 22.6 22.6 22.8 23 23 23.2 23.3 23.5 23.5 23.5 23.6 23.6 23.6 23.6 23.6 23.7 23.7 23.9 23.9 23.9 23.9 23.9 23.9 24 24 24.1 24.1 24.2 24.2 24.2 24.2 24.3 24.3 24.3 24.4 24.6 24.6 24.7 24.7 24.7 24.8 25.1 25.2 25.3 25.4 25.6 25.6 25.7 26 26.3 26.5

Current
Mean: 24.167 %
Stdev: 1.441 % (6.0%)
Runs: 21.3 21.5 21.6 22.2 22.3 22.5 22.6 22.6 22.6 22.7 22.8 23 23 23.2 23.2 23.2 23.5 23.5 23.6 23.6 23.6 23.7 23.8 23.9 24 24 24 24.2 24.2 24.2 24.2 24.2 24.2 24.3 24.3 24.3 24.4 24.4 24.5 24.5 24.6 24.6 24.7 24.7 25 25.3 25.3 25.3 25.3 25.5 25.5 25.6 26.3 26.6 26.9 26.9 28 28.2 |
| Report typing Composer typing rerender count | Baseline
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

Current
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

github-actions · 2025-03-19T20:23:45Z

Performance Test Results (Part ag)

| Report typing Message sent | Baseline
Mean: 434.716 ms
Stdev: 23.310 ms (5.4%)
Runs: 388.1742759998888 388.259440000169 388.94795699976385 390.55318299960345 391.0314540001564 391.43310500029474 394.49190300004557 401.06168700009584 405.0239659999497 405.7679040003568 408.0880120000802 411.80574500001967 412.238404000178 412.81103500025347 413.99772199988365 414.4674889999442 414.61649599997327 421.8220620001666 426.0957030002028 426.53137199999765 427.73856600001454 430.2639160002582 436.15177400037646 439.868978000246 439.9068610002287 441.4934489997104 443.9030349999666 444.0252689998597 444.58353700023144 444.69079599995166 444.94510999973863 445.04956000018865 445.26350999996066 445.6871339995414 446.24576800037175 446.7420659996569 447.37801100034267 447.4532059999183 447.6286220001057 447.7847489994019 447.8130290005356 448.37939499970526 448.4471439998597 448.82442199997604 449.3129470003769 450.06636599916965 450.1149499998428 450.73832200001925 450.755737000145 452.82499200012535 454.60587599966675 454.65348399989307 454.76468999963254 457.5352380005643 458.88810299988836 461.52604199945927 464.80204300023615 470.35738199949265 471.0927729997784 473.4397790003568

Current
Mean: 435.285 ms
Stdev: 26.047 ms (6.0%)
Runs: 381.26997900009155 384.2084960001521 387.07743299985304 387.44824300007895 392.4662270001136 394.1015630001202 395.18123399978504 399.837728000246 404.19335999991745 405.44633000018075 406.80826900014654 409.0404050000943 409.0771890003234 409.11914099985734 410.06140099978074 410.82519599981606 417.9177660001442 422.1736660003662 423.97009300021455 424.2080890000798 427.45369399990886 427.7343350001611 428.286987000145 429.86568199982867 433.1942960000597 437.93802999984473 438.12182600051165 441.0793049996719 442.21435599960387 444.0855310000479 444.32120699994266 445.0848390003666 446.8197429999709 446.91084800008684 447.23575800005347 447.8783370004967 448.19128399994224 448.34269300010055 448.70638000033796 448.7843429995701 448.8238120004535 449.0491140000522 449.796427000314 451.4688720004633 451.8238120004535 453.0466310000047 457.0618489999324 457.20906599983573 457.3945319997147 457.4860439999029 458.21236100047827 459.7371420003474 462.27201400045305 463.45462999958545 464.45231200009584 466.5379639994353 469.95084699988365 470.5149739999324 475.4781089993194 496.6206879997626 |
| Report typing (CPU) | Baseline
Mean: 90.282 %
Stdev: 2.521 % (2.8%)
Runs: 85.66884678241543 86.23981588195174 87.02915909265123 87.35936589319941 87.70356715064624 87.80537297113656 87.82015788576363 87.8422965586478 87.9863886948843 88.06045989043483 88.09952268357068 88.16815339269424 88.17007948163055 88.33420949875294 88.38545491982427 88.53946505362144 88.63165884025163 88.84251746527403 88.85765860897155 88.86822375170908 89.17442846021528 89.17778716870893 89.28152533904155 89.43062901626278 89.43598634130161 89.46570388029576 89.48668657831678 89.53297315225078 89.53582758145023 89.79439304661612 89.8114511502786 89.90118922595495 89.9266341546018 90.14678375332224 90.24688621484518 90.5484412150503 90.72686251538703 90.75056207616495 90.93909778768315 91.08604605320565 91.32370734756314 91.3561800057901 91.54089067163066 91.61206015398737 91.691622671283 91.97302055587062 92.78956193928978 92.9475605820232 92.99746520528555 93.87336732862784 93.95291820556339 94.21075417288907 95.06837497816092 95.18588494786327 95.4235888112601 96.29835037567052 97.02379172677769

Current
Mean: 90.793 %
Stdev: 3.306 % (3.6%)
Runs: 85.60927647923805 86.00414114923356 86.3018739660045 86.60707195346725 86.72333122210927 86.80586718201339 86.98542689356505 87.17505812638424 87.33947102097831 87.3561440162749 87.5865735111403 87.87331343099416 87.99474430229934 87.99975069328134 88.49029545428074 88.5162324857686 88.74952176515924 88.7862847730681 88.8989423477809 89.05141729070735 89.21048564007698 89.25886769258008 89.49552001782469 89.57558658343099 89.64373070691775 89.94294019987505 90.08964572909736 90.19517374734366 90.20402374391725 90.4095719376524 90.4404176593925 90.61360396390113 90.80583959096865 90.89805632816518 91.16117801658537 91.4608001063777 91.78729264766781 92.5847229349489 92.7809797306111 92.94233386664119 93.01559458880631 93.17928665174428 93.21065666592222 93.63860035491834 94.24772653057634 94.61469766586187 95.29349842720013 95.49211135088949 95.52111684590801 95.61499040042469 95.89490718601704 96.18009455377013 96.33225083249717 97.64683972529689 99.357605166675 |
| Report typing (FPS) | Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

github-actions · 2025-03-19T20:23:46Z

Performance Test Results (Part ah)

| Report typing (RAM) | Baseline
Mean: 447.063 MB
Stdev: 5.893 MB (1.3%)
Runs: 432.83203125 435.42507102272725 435.96261160714283 437.0558763586956 437.26153273809524 437.34969429347825 438.8890964673913 440.2712296195652 441.1030910326087 441.3954613095238 441.6663707386364 442.06494140625 442.39385190217394 442.4008556547619 442.44229403409093 442.46750710227275 442.5589657738095 443.4996279761905 444.3043323863636 444.4177989130435 444.6677989130435 444.81640625 445.0757472826087 445.1706861413044 446.0536684782609 446.1329823369565 446.6580255681818 446.78018465909093 446.8361073369565 447.4431046195652 448.41139914772725 448.6990411931818 448.928515625 449.3491847826087 449.35049715909093 449.39011548913044 449.6615149456522 449.7478693181818 450.2678328804348 450.3773777173913 450.6154119318182 450.8861328125 451.21200284090907 451.9884588068182 452.3213315217391 452.67153532608694 452.8994565217391 452.99441964285717 453.04829545454544 453.3211616847826 453.52265625 453.771484375 454.55112092391306 455.0279017857143 455.09375 455.11044034090907 455.99147727272725 456.021484375 456.084375

Current
Mean: 446.158 MB
Stdev: 4.664 MB (1.0%)
Runs: 434.0225183823529 435.62723214285717 437.49200148809524 437.7734375 437.8728515625 441.13705842391306 441.4011548913044 441.4708984375 441.5513392857143 441.8004261363636 441.94853940217394 442.51246279761904 442.804443359375 442.9774116847826 443.0261548913044 443.0645461309524 443.5673828125 443.73456101190476 443.79636548913044 444.0672554347826 444.3646399456522 445.0576636904762 445.43696732954544 445.53057065217394 445.9541440217391 446.1279761904762 446.3296535326087 446.3386548913044 447.2511888586956 447.3175951086956 447.64609375 447.7316576086956 447.7498301630435 447.7629076086956 448.2109375 448.3673573369565 448.4624660326087 448.5023777173913 448.61700148809524 448.84765625 449.1299252717391 449.4707961309524 449.58860085227275 449.77021059782606 450.21552309782606 450.24252717391306 450.59375 450.59969429347825 451.1302083333333 451.2796519886364 451.41049592391306 451.50710227272725 451.8143601190476 453.89656929347825 454.5935724431818 456.3338068181818 |
| Report typing (CPU/JS) | Baseline
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

Current
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 |
| Report typing (CPU/UI) | Baseline
Mean: 21.142 %
Stdev: 0.691 % (3.3%)
Runs: 19.8 19.9 20 20 20.2 20.2 20.3 20.4 20.4 20.4 20.4 20.5 20.5 20.6 20.6 20.8 20.8 20.8 20.8 20.9 20.9 20.9 20.9 20.9 21 21 21 21 21 21.2 21.2 21.2 21.3 21.3 21.4 21.4 21.4 21.4 21.4 21.4 21.5 21.6 21.6 21.6 21.8 21.8 21.8 21.8 22 22 22.1 22.1 22.1 22.2 22.3 22.4 22.9

Current
Mean: 21.184 %
Stdev: 0.738 % (3.5%)
Runs: 19.4 19.6 19.9 19.9 20 20.2 20.4 20.5 20.6 20.6 20.7 20.7 20.8 20.8 20.8 20.8 20.8 20.9 21 21 21 21 21.1 21.1 21.1 21.1 21.1 21.2 21.2 21.2 21.2 21.3 21.3 21.3 21.4 21.4 21.4 21.4 21.4 21.5 21.5 21.6 21.7 21.8 21.8 21.8 21.8 22 22 22.1 22.1 22.2 22.4 22.9 23.3 |
| Chat opening Chat TTI | Baseline
Mean: 904.604 ms
Stdev: 26.955 ms (3.0%)
Runs: 843.582397999242 848.3727219998837 855.8269050000235 861.0620130002499 862.2807210003957 862.981119999662 870.3651940003037 871.1552740000188 874.1172690000385 874.3232829999179 876.7491459995508 878.6125900000334 879.9348149998114 880.5057789999992 882.0287269996479 884.4405519999564 884.5460209995508 887.9905200004578 888.1300060003996 888.6284190006554 889.1300870003179 890.9389660004526 892.1278079999611 896.5065510002896 899.3284910004586 902.4538169996813 910.3212900003418 910.4213870000094 911.5167650002986 911.5213219998404 911.953735999763 913.1033540004864 914.3369960002601 916.203735999763 917.0771490000188 917.1988530000672 921.5716970004141 921.7956550000235 922.01977599971 922.1769209997728 922.2443450000137 922.6430670004338 924.7780349999666 926.9957280000672 927.5179859995842 927.8799650007859 928.7242440003902 929.4513760004193 931.0469980007038 931.5357670001686 931.900391000323 931.9991859998554 932.7549240002409 933.5599779998884 934.682089000009 938.4996750000864 943.8358160005882 944.802938000299 959.426188999787

Current
Mean: 898.601 ms
Stdev: 27.149 ms (3.0%)
Runs: 827.7545990003273 844.8010660000145 845.5796309998259 857.1358639998361 863.078003000468 863.844402000308 866.4280610000715 868.5022379998118 868.7025560000911 870.8457840001211 873.2693689996377 876.1722820000723 876.2229830008 878.2967130001634 879.6154789999127 883.697877000086 884.4560139998794 885.1672360002995 887.853190000169 888.4072270002216 889.3068850003183 891.7875570002943 892.8623860003427 893.9386400002986 894.627766999416 896.6416830001399 897.9620369998738 898.4547530002892 900.3338219998404 900.9659020006657 901.0951340002939 902.8224689997733 903.3945730002597 903.528605999425 903.8771569998935 906.1119389999658 906.1123449997976 908.4235030002892 908.5000809999183 909.6407070001587 909.9284670008346 911.2710380004719 912.8464360004291 913.066570000723 915.7723799999803 920.2869070004672 920.4148769993335 922.3367109997198 924.7545170001686 926.2633469998837 928.3541670003906 936.6017260001972 938.0480149993673 938.9156089993194 939.7216809997335 945.2327070003375 956.7411299999803 958.0678719999269

github-actions · 2025-03-19T20:23:47Z

Performance Test Results (Part ai)

| Chat opening (CPU) | Baseline
Mean: 153.988 %
Stdev: 2.815 % (1.8%)
Runs: 147.4070507329649 149.1780640070962 149.96368939621468 150.13621993697853 150.38688967779342 150.76934887351325 150.97880264668478 150.99646856834457 151.30883620524094 151.39279515215884 151.53635625180564 151.63531165070071 151.82559843033573 151.9165971031798 151.93657588143222 152.05474651886252 152.25996737038162 152.41334067761247 152.72095153041911 152.95507845336314 152.97606993641148 153.10983905476954 153.1989889274282 153.20520241373254 153.22421144574562 153.35508488734854 153.4318380164184 153.45723407724196 153.459599119743 153.5007264794246 153.58366114993896 153.61624817265712 153.76325627421753 153.87901598513943 154.02328423851984 154.16383752364644 154.16603899816357 154.46484674771324 154.66788675503392 155.05989039179258 155.36281751534537 155.61037538160528 155.7979571930705 155.81495446475174 155.9649199507592 155.97455595018505 156.14594356569384 156.30678914628803 156.38476117002222 157.34820943492778 157.38190131966783 158.10646390804308 158.51732129272807 158.7072654155107 158.90242527884052 159.53933546123497 159.98005349255533 161.37397195122816

Current
Mean: 154.178 %
Stdev: 3.216 % (2.1%)
Runs: 147.1062741477727 147.240051699566 147.87128770550643 148.4583268181442 149.4051980714035 149.6396176510579 149.9301554429885 150.81825668171504 151.18584186273006 151.66277734177766 151.72266335024108 151.78937912549432 151.9029630237752 152.046241544277 152.19389410789253 152.2116705976151 152.60654105034735 152.66548549885147 152.68643084070456 152.97106030274415 153.12552459783473 153.1272866639889 153.14142767548233 153.28553261217712 153.6352736301862 153.721992074735 153.80305951220245 153.9735610497944 153.99554310662447 154.15161450254436 154.28957295834252 154.3517757028401 154.40093323578367 154.55987824893074 154.87083758675905 154.9430010278205 155.38681552394144 155.59501204262693 155.61770432146994 155.82087229791523 155.85792692861799 156.22588072616523 156.24082942995346 156.24998480622523 156.78562865141438 156.89924646551174 156.93070960662672 156.95015774039942 157.29942594328566 157.46448081254056 157.6550546261307 157.71532504509156 157.77636951169416 158.06005428431519 158.67995694240778 160.01039885700044 161.60040210190536 162.02456118456087 |
| Chat opening (FPS) | Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 |
| Chat opening (RAM) | Baseline
Mean: 383.839 MB
Stdev: 4.644 MB (1.2%)
Runs: 376.04296875 376.12421875 376.5921875 377.7359375 378.10625 378.11796875 378.18515625 378.3138020833333 378.40390625 378.50078125 378.55 378.5859375 378.69453125 379.0140625 379.0703125 379.8424479166667 379.925 380.43125 380.503125 380.8424479166667 381.75859375 381.93125 382.2984375 382.828125 382.840625 383.2467447916667 383.2875 383.50859375 383.66953125 384.0109375 384.09296875 384.1671875 384.2220052083333 384.23671875 384.51953125 384.64375 384.6609375 384.7359375 385.3 385.3092447916667 385.5026041666667 385.8209635416667 386.0618489583333 386.83125 387.4296875 387.584375 387.7291666666667 387.815625 387.8365885416667 389.2701822916667 389.5104166666667 389.720703125 389.7506510416667 389.8890625 390.2298177083333 390.3190104166667 391.9485677083333 392.66796875 393.55078125 393.9984375

Current
Mean: 382.737 MB
Stdev: 3.984 MB (1.0%)
Runs: 375.4342447916667 375.50390625 375.78515625 376.1497395833333 376.4290364583333 376.9205729166667 377.326171875 377.8609375 378.484375 378.5240885416667 378.525390625 378.62109375 378.68359375 379.5953125 380.38203125 380.4423828125 380.4541015625 380.76171875 380.8609375 380.8625 380.8703125 381.07109375 381.184375 381.2234375 381.3125 381.61328125 381.67890625 381.69140625 381.8489583333333 382.1647135416667 382.3665364583333 382.56796875 383.009375 383.4546875 383.83125 384.0671875 384.388671875 384.6203125 385.1578125 385.2102864583333 385.65625 385.65625 385.81484375 385.90625 385.951171875 386.5875 386.61640625 386.62421875 386.662109375 387.01796875 387.90625 387.99140625 388.0260416666667 388.181640625 388.3971354166667 388.46484375 388.8157552083333 389.767578125 390.4895833333333

github-actions · 2025-03-19T20:23:48Z

Performance Test Results (Part aj)

| Chat opening (CPU/JS) | Baseline
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

Current
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 |
| Chat opening (CPU/UI) | Baseline
Mean: 31.190 %
Stdev: 1.932 % (6.2%)
Runs: 27.1 27.5 28.3 28.5 28.5 28.6 28.6 28.8 29 29 29.1 29.1 29.1 29.3 29.4 29.5 29.6 30.3 30.3 30.4 30.6 30.6 30.6 30.7 30.9 31.1 31.1 31.2 31.3 31.5 31.5 31.5 31.5 31.6 31.6 31.8 31.9 31.9 31.9 31.9 32 32.2 32.2 32.4 32.5 32.5 32.7 32.8 32.9 33.1 33.2 33.6 34 34 34.1 34.3 34.8 35 35.2

Current
Mean: 31.000 %
Stdev: 1.807 % (5.8%)
Runs: 27.6 28 28.4 28.5 28.7 28.7 29 29.1 29.3 29.5 29.5 29.5 29.6 29.7 29.7 29.7 29.9 29.9 29.9 30 30 30 30 30.1 30.2 30.3 30.3 30.4 30.7 30.7 30.8 30.9 31 31.1 31.1 31.5 31.5 31.5 31.6 31.6 31.7 31.7 31.8 31.9 32.2 32.2 32.4 32.7 32.8 33 33.2 33.2 33.3 33.6 33.8 34.2 34.9 35.3 35.6 |

⚠️ Some tests did not pass successfully, so some results are omitted from final report: Linking

github-actions · 2025-03-19T20:23:49Z

@Expensify/mobile-deployers 📣 Please look into this performance regression as it's a deploy blocker.

chrispader · 2025-03-19T20:59:15Z

@mountiny @grgia the pipeline now succeeds... It basically just splits up the pipeline output by into multiple files.

Let me look into some way of making this prettier and only splitting up everything that exceeds the maximum 65536 characters.

luacmartins · 2025-03-19T21:32:04Z

lol, not sure why the deploy blocker label was added to this one since it's not even merged yet

techievivek · 2025-03-20T15:03:35Z

@mountiny Do you wanna take over as a reviewer here since you have context on the changes?

mountiny · 2025-03-20T15:31:23Z

OK

chrispader · 2025-03-28T16:53:22Z

How's it going here?

I will finish this PR by tomorrow. I already have a good picture of what needs to be changed.

chrispader · 2025-03-29T13:18:14Z

@mountiny @grgia i just updated the code for creating the Markdown output files. Could you re-run the pipeline? Thanks 🙌🏼

This reverts commit 8103cee.

mountiny · 2025-03-31T10:42:15Z

Kicked off a new build

mountiny · 2025-03-31T13:44:11Z

Reviewer Checklist

I have verified the author checklist is complete (all boxes are checked off).
I verified the correct issue is linked in the ### Fixed Issues section above
I verified testing steps are clear and they cover the changes made in this PR
- I verified the steps for local testing are in the Tests section
- I verified the steps for Staging and/or Production testing are in the QA steps section
- I verified the steps cover any possible failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
- I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
I checked that screenshots or videos are included for tests on all platforms
I included screenshots or videos for tests on all platforms
I verified that the composer does not automatically focus or open the keyboard on mobile unless explicitly intended. This includes checking that returning the app from the background does not unexpectedly open the keyboard.
I verified tests pass on all platforms & I tested again on:
- Android: Native
- Android: mWeb Chrome
- iOS: Native
- iOS: mWeb Safari
- MacOS: Chrome / Safari
- MacOS: Desktop
If there are any errors in the console that are unrelated to this PR, I either fixed them (preferred) or linked to where I reported them in Slack
I verified proper code patterns were followed (see Reviewing the code)
- I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick).
- I verified that comments were added to code that is not self explanatory
- I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
- I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
- I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
- I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
- I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
- I verified the JSDocs style guidelines (in STYLE.md) were followed
If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
I verified that this PR follows the guidelines as stated in the Review Guidelines
I verified other components that can be impacted by these changes have been tested, and I retested again (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar have been tested & I retested again)
I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
I verified any variables that can be defined as constants (ie. in CONST.ts or at the top of the file that uses the constant) are defined as such
If a new component is created I verified that:
- A similar component doesn't exist in the codebase
- All props are defined accurately and each prop has a /** comment above it */
- The file is named correctly
- The component has a clear name that is non-ambiguous and the purpose of the component can be inferred from the name alone
- The only data being stored in the state is data necessary for rendering and nothing else
- For Class Components, any internal methods passed to components event handlers are bound to this properly so there are no scoping issues (i.e. for onClick={this.submit} the method this.submit should be bound to this in the constructor)
- Any internal methods bound to this are necessary to be bound (i.e. avoid this.submit = this.submit.bind(this); if this.submit is never passed to a component event handler like onClick)
- All JSX used for rendering exists in the render method
- The component has the minimum amount of code necessary for its purpose, and it is broken down into smaller components in order to separate concerns and functions
If any new file was added I verified that:
- The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory
If a new CSS style is added I verified that:
- A similar style doesn't already exist
- The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG)
If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
- I verified that all the inputs inside a form are aligned with each other.
- I added Design label and/or tagged @Expensify/design so the design team can review the changes.
If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
For any bug fix or new feature in this PR, I verified that sufficient unit tests are included to prevent regressions in this flow.
If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.
I have checked off every checkbox in the PR reviewer checklist, including those that don't apply to this PR.

Screenshots/Videos

Android: Native

Android: mWeb Chrome

iOS: Native

iOS: mWeb Safari

MacOS: Chrome / Safari

MacOS: Desktop

mountiny

One small comment

.github/workflows/checkE2ETestCode.yml

Co-authored-by: Vit Horacek <[email protected]>

mountiny

Thanks!

OSBotify · 2025-03-31T14:30:04Z

✋ This PR was not deployed to staging yet because QA is ongoing. It will be automatically deployed to staging after the next production release.

github-actions · 2025-04-01T15:38:43Z

🚀 Deployed to staging by https://github.com/mountiny in version: 9.1.22-0 🚀

platform	result
🖥 desktop 🖥	success ✅
🕸 web 🕸	success ✅
🤖 android 🤖	success ✅
🍎 iOS 🍎	success ✅

github-actions · 2025-04-03T11:40:05Z

🚀 Deployed to production by https://github.com/grgia in version: 9.1.22-10 🚀

platform	result
🖥 desktop 🖥	success ✅
🕸 web 🕸	success ✅
🤖 android 🤖	failure ❌
🍎 iOS 🍎	success ✅

chrispader added 2 commits March 19, 2025 17:18

split up too big output files in e2e performance pipelein

769a768

fix: decrease maximum file size threshold and improve check

5e03a1b

chrispader requested a review from a team as a code owner March 19, 2025 16:24

melvin-bot bot requested a review from techievivek March 19, 2025 16:24

melvin-bot bot removed the request for review from a team March 19, 2025 16:24

rename step

8a591d0

grgia mentioned this pull request Mar 19, 2025

Investigate workflow job failing on main: e2ePerformanceTests / Run E2E tests in AWS device farm #58720

Closed

fix: wrong stat command under linux

6190d9c

dangrous mentioned this pull request Mar 19, 2025

Investigate workflow job failing on main: e2ePerformanceTests / Run E2E tests in AWS device farm #58739

Closed

github-actions bot added the DeployBlockerCash This issue or pull request should block deployment label Mar 19, 2025

github-actions bot mentioned this pull request Mar 19, 2025

Deploy Checklist: New Expensify 2025-03-18 #58665

Closed

54 tasks

luacmartins removed the DeployBlockerCash This issue or pull request should block deployment label Mar 19, 2025

mountiny requested review from mountiny and removed request for techievivek March 20, 2025 15:31

chrispader added 2 commits March 29, 2025 14:14

fix: split e2e performance test markdown into multiple files

6e61bdf

chore: remove splitting up step in e2e performance workflow

50d729f

chrispader added 11 commits March 31, 2025 08:05

fix: improve file splitting even more

6b89ba3

fix: e2e performance tests lint pipeline build

348a36f

fix: endless recursion

2d6ea56

fix: recursion

11b5b2f

fix: buildDetailsTable

2dcd542

Update E2EMarkdownTest.ts.snap

8103cee

fix: output files in pipeline

4580aea

fix: simplify and fix array logic

8c4b7bf

Revert "Update E2EMarkdownTest.ts.snap"

d02cb57

This reverts commit 8103cee.

fix: e2e markdown test

7c96cdc

fix: wrong output filename in pipeline

66c66c6

mountiny changed the title ~~fix: Split up too big output files in E2E performance pipelines~~ [NoQA] fix: Split up too big output files in E2E performance pipelines Mar 31, 2025

mountiny previously approved these changes Mar 31, 2025

View reviewed changes

.github/workflows/checkE2ETestCode.yml Show resolved Hide resolved

Update .github/workflows/checkE2ETestCode.yml

fa2cb93

Co-authored-by: Vit Horacek <[email protected]>

chrispader dismissed mountiny’s stale review via fa2cb93 March 31, 2025 13:54

mountiny approved these changes Mar 31, 2025

View reviewed changes

mountiny merged commit 3c62f31 into Expensify:main Mar 31, 2025
19 checks passed

chrispader mentioned this pull request Apr 1, 2025

[NoQA] Follow-Up: Also print E2E performance pipeline results from split files to console #59436

Merged

50 tasks

github-actions bot mentioned this pull request Apr 1, 2025

Deploy Checklist: New Expensify 2025-04-01 #59448

Closed

60 tasks

This was referenced Apr 3, 2025

[Due for payment 2025-04-10] Investigate workflow job failing on main: e2ePerformanceTests / Run E2E tests in AWS device farm #58715

Closed

[Due for payment 2025-04-14] [Due for payment 2025-04-10] Fix GH actions report when E2E tests fail #59002

Closed

[NoQA] fix: Split up too big output files in E2E performance pipelines #58740

[NoQA] fix: Split up too big output files in E2E performance pipelines #58740

Uh oh!

Conversation

chrispader commented Mar 19, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Explanation of Change

Fixed Issues

Tests

Offline tests

QA Steps

PR Author Checklist

Screenshots/Videos

Uh oh!

melvin-bot bot commented Mar 19, 2025

Uh oh!

github-actions bot commented Mar 19, 2025

Performance Test Results (Part aa)

Performance Comparison Report 📊

Significant Changes To Duration

Meaningless Changes To Duration

Uh oh!

github-actions bot commented Mar 19, 2025

Performance Test Results (Part ab)

Uh oh!

github-actions bot commented Mar 19, 2025

Performance Test Results (Part ac)

Uh oh!

github-actions bot commented Mar 19, 2025

Performance Test Results (Part ad)

Uh oh!

github-actions bot commented Mar 19, 2025

Performance Test Results (Part ae)

Uh oh!

github-actions bot commented Mar 19, 2025

Performance Test Results (Part af)

Uh oh!

github-actions bot commented Mar 19, 2025

Performance Test Results (Part ag)

Uh oh!

github-actions bot commented Mar 19, 2025

Performance Test Results (Part ah)

Uh oh!

github-actions bot commented Mar 19, 2025

Performance Test Results (Part ai)

Uh oh!

github-actions bot commented Mar 19, 2025

Performance Test Results (Part aj)

Uh oh!

github-actions bot commented Mar 19, 2025

Uh oh!

chrispader commented Mar 19, 2025

Uh oh!

luacmartins commented Mar 19, 2025

Uh oh!

techievivek commented Mar 20, 2025

Uh oh!

mountiny commented Mar 20, 2025

Uh oh!

chrispader commented Mar 28, 2025

Uh oh!

chrispader commented Mar 29, 2025

Uh oh!

mountiny commented Mar 31, 2025

Uh oh!

mountiny commented Mar 31, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Reviewer Checklist

Screenshots/Videos

Uh oh!

mountiny left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

mountiny left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

OSBotify commented Mar 31, 2025

Uh oh!

chrispader commented Mar 19, 2025 •

edited

Loading

mountiny commented Mar 31, 2025 •

edited

Loading