Skip to content

[CP Staging] Remove beta newDotHelpSidePanel, show help button only based on Onyx key #60135

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Apr 11, 2025

Conversation

francoisl
Copy link
Contributor

@francoisl francoisl commented Apr 11, 2025

Explanation of Change

This removes the beta newDotHelpSidePanel, and restores the logic to show the help side panel button to be only based on the Onyx key nvp_sidePanel, so that we can more easily test on any account by running Onyx.set("nvp_sidePanel", {}); in the JS console.

Fixed Issues

$ #60069
https://expensify.slack.com/archives/C07NZ8B1VTQ/p1744318812379879?thread_ts=1743366781.999989&cid=C07NZ8B1VTQ

Tests

  1. Sign in to any account
  2. Make sure you do not see the "❔" help panel button in the top right corner
  3. [Web/Desktop]:
    1. Open the JS console
      1. Run:
    Onyx.set("nvp_sidePanel", {});
  4. [Mobile]:
    1. Go to Settings > Troubleshoot > [Enable Client side logging] > View debug console
    2. Enter and submit command: Onyx.set("nvp_sidePanel", {});
  5. Make sure the "❔" help panel button appears in the UI
  6. Click the button, verify that the help panel opens
  7. Navigate between different pages of the app, and verify that the content of the side panel updates accordingly
  8. [Web/Desktop]:
    1. In the JS console, run:
    Onyx.set("nvp_sidePanel", null);
  9. [Mobile]:
    1. Go to Settings > Troubleshoot > > View debug console
    2. Enter and submit command: Onyx.set("nvp_sidePanel", null);
  10. Verify that the help panel closes and the "❔" button is no longer visible
  • Verify that no errors appear in the JS console

Offline tests

Same as tests

QA Steps

Same as test steps above

  • Verify that no errors appear in the JS console

PR Author Checklist

  • I linked the correct issue in the ### Fixed Issues section above
  • I wrote clear testing steps that cover the changes made in this PR
    • I added steps for local testing in the Tests section
    • I added steps for the expected offline behavior in the Offline steps section
    • I added steps for Staging and/or Production testing in the QA steps section
    • I added steps to cover failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
    • I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
    • I tested this PR with a High Traffic account against the staging or production API to ensure there are no regressions (e.g. long loading states that impact usability).
  • I included screenshots or videos for tests on all platforms
  • I ran the tests on all platforms & verified they passed on:
    • Android: Native
    • Android: mWeb Chrome
    • iOS: Native
    • iOS: mWeb Safari
    • MacOS: Chrome / Safari
    • MacOS: Desktop
  • I verified there are no console errors (if there's a console error not related to the PR, report it or open an issue for it to be fixed)
  • I followed proper code patterns (see Reviewing the code)
    • I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick)
    • I verified that comments were added to code that is not self explanatory
    • I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
    • I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
      • If any non-english text was added/modified, I used JaimeGPT to get English > Spanish translation. I then posted it in #expensify-open-source and it was approved by an internal Expensify engineer. Link to Slack message:
    • I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
    • I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
    • I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
    • I verified the JSDocs style guidelines (in STYLE.md) were followed
  • If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
  • I followed the guidelines as stated in the Review Guidelines
  • I tested other components that can be impacted by my changes (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar are working as expected)
  • I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
  • I verified any variables that can be defined as constants (ie. in CONST.ts or at the top of the file that uses the constant) are defined as such
  • I verified that if a function's arguments changed that all usages have also been updated correctly
  • If any new file was added I verified that:
    • The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory
  • If a new CSS style is added I verified that:
    • A similar style doesn't already exist
    • The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG))
  • If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
  • If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
  • If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
  • If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
  • If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
    • I verified that all the inputs inside a form are aligned with each other.
    • I added Design label and/or tagged @Expensify/design so the design team can review the changes.
  • If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
  • I added unit tests for any new feature or bug fix in this PR to help automatically prevent regressions in this user flow.
  • If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.

Screenshots/Videos

MacOS: Chrome / Safari
Screen.Recording.2025-04-11.at.10.25.47.mov

@francoisl francoisl self-assigned this Apr 11, 2025
…x key

Revert "Merge pull request #59221 from software-mansion-labs/side-pane-feature-flag"

This reverts commit 5f1a121, reversing
changes made to b8b68af.
@francoisl francoisl force-pushed the francois-revert-59221 branch from e0535e4 to 6ab3907 Compare April 11, 2025 17:39
@francoisl francoisl requested a review from brunovjk April 11, 2025 17:48
@francoisl francoisl marked this pull request as ready for review April 11, 2025 17:48
@francoisl francoisl requested a review from a team as a code owner April 11, 2025 17:48
@melvin-bot melvin-bot bot removed the request for review from a team April 11, 2025 17:48
Copy link

melvin-bot bot commented Apr 11, 2025

@ Please copy/paste the Reviewer Checklist from here into a new comment on this PR and complete it. If you have the K2 extension, you can simply click: [this button]

@francoisl
Copy link
Contributor Author

To add clarity: if you sign out and then sign back in, it's expected that the button won't appear anymore. The NVP is not persisted to the backend.

@brunovjk
Copy link
Contributor

brunovjk commented Apr 11, 2025

Reviewer Checklist

  • I have verified the author checklist is complete (all boxes are checked off).
  • I verified the correct issue is linked in the ### Fixed Issues section above
  • I verified testing steps are clear and they cover the changes made in this PR
    • I verified the steps for local testing are in the Tests section
    • I verified the steps for Staging and/or Production testing are in the QA steps section
    • I verified the steps cover any possible failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
    • I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
  • I checked that screenshots or videos are included for tests on all platforms
  • I included screenshots or videos for tests on all platforms
  • I verified that the composer does not automatically focus or open the keyboard on mobile unless explicitly intended. This includes checking that returning the app from the background does not unexpectedly open the keyboard.
  • I verified tests pass on all platforms & I tested again on:
    • Android: Native
    • Android: mWeb Chrome
    • iOS: Native
    • iOS: mWeb Safari
    • MacOS: Chrome / Safari
    • MacOS: Desktop
  • If there are any errors in the console that are unrelated to this PR, I either fixed them (preferred) or linked to where I reported them in Slack
  • I verified proper code patterns were followed (see Reviewing the code)
    • I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick).
    • I verified that comments were added to code that is not self explanatory
    • I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
    • I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
    • I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
    • I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
    • I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
    • I verified the JSDocs style guidelines (in STYLE.md) were followed
  • If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
  • I verified that this PR follows the guidelines as stated in the Review Guidelines
  • I verified other components that can be impacted by these changes have been tested, and I retested again (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar have been tested & I retested again)
  • I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
  • I verified any variables that can be defined as constants (ie. in CONST.ts or at the top of the file that uses the constant) are defined as such
  • If a new component is created I verified that:
    • A similar component doesn't exist in the codebase
    • All props are defined accurately and each prop has a /** comment above it */
    • The file is named correctly
    • The component has a clear name that is non-ambiguous and the purpose of the component can be inferred from the name alone
    • The only data being stored in the state is data necessary for rendering and nothing else
    • For Class Components, any internal methods passed to components event handlers are bound to this properly so there are no scoping issues (i.e. for onClick={this.submit} the method this.submit should be bound to this in the constructor)
    • Any internal methods bound to this are necessary to be bound (i.e. avoid this.submit = this.submit.bind(this); if this.submit is never passed to a component event handler like onClick)
    • All JSX used for rendering exists in the render method
    • The component has the minimum amount of code necessary for its purpose, and it is broken down into smaller components in order to separate concerns and functions
  • If any new file was added I verified that:
    • The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory
  • If a new CSS style is added I verified that:
    • A similar style doesn't already exist
    • The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG)
  • If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
  • If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
  • If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
  • If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
  • If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
    • I verified that all the inputs inside a form are aligned with each other.
    • I added Design label and/or tagged @Expensify/design so the design team can review the changes.
  • If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
  • For any bug fix or new feature in this PR, I verified that sufficient unit tests are included to prevent regressions in this flow.
  • If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.
  • I have checked off every checkbox in the PR reviewer checklist, including those that don't apply to this PR.

Screenshots/Videos

Android: Native
60135_android_native.mov
Android: mWeb Chrome
60135_android_web.mov
iOS: Native
60135_ios_native.mov
iOS: mWeb Safari
60135_ios_web.mov
MacOS: Chrome / Safari
60135_web_chrome.mov
MacOS: Desktop
60135_web_desktop.mov

Copy link
Contributor

@brunovjk brunovjk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Just pay attention to this comment.

To open the console in others platforms, use this tutorial and/or the app's own "Debug console": Go to "Settings" > "Troubleshoot" > Enable "Client side logging" > Click "View debug console"

@melvin-bot melvin-bot bot requested a review from arosiclair April 11, 2025 22:42
Copy link

melvin-bot bot commented Apr 11, 2025

@arosiclair Please copy/paste the Reviewer Checklist from here into a new comment on this PR and complete it. If you have the K2 extension, you can simply click: [this button]

@francoisl francoisl removed the request for review from arosiclair April 11, 2025 22:51
@francoisl francoisl changed the title Remove beta newDotHelpSidePanel, show help button only based on Onyx key [CP Staging] Remove beta newDotHelpSidePanel, show help button only based on Onyx key Apr 11, 2025
@chiragsalian chiragsalian merged commit a00349b into main Apr 11, 2025
19 checks passed
@chiragsalian chiragsalian deleted the francois-revert-59221 branch April 11, 2025 22:52
@chiragsalian
Copy link
Contributor

Was asked to review/merge early since we want to CP so took over the review.

OSBotify pushed a commit that referenced this pull request Apr 11, 2025
[CP Staging] Remove beta `newDotHelpSidePanel`, show help button only based on Onyx key

(cherry picked from commit a00349b)

(CP triggered by francoisl)
@github-actions github-actions bot added the CP Staging marks PRs that have been CP'd to staging label Apr 11, 2025
@OSBotify
Copy link
Contributor

✋ This PR was not deployed to staging yet because QA is ongoing. It will be automatically deployed to staging after the next production release.

Copy link
Contributor

🚀 Cherry-picked to staging by https://github.com/francoisl in version: 9.1.27-2-staging 🚀

platform result
🖥 desktop 🖥 success ✅
🕸 web 🕸 success ✅
🤖 android 🤖 success ✅
🍎 iOS 🍎 success ✅

@Expensify/applauseleads please QA this PR and check it off on the deploy checklist if it passes.

@github-actions github-actions bot added the DeployBlockerCash This issue or pull request should block deployment label Apr 12, 2025
Copy link
Contributor

Performance Comparison Report 📊 (1/3)

⚠️ Some tests did not pass successfully, so some results are omitted from final report: Linking

Significant Changes To Duration

Name Duration
Open search router TTI Open Search Router TTI 1903.275 ms → 2056.969 ms (+153.694 ms, +8.1%) 🔴
Show details
Name Duration
Open search router TTI Open Search Router TTI Baseline
Mean: 1903.275 ms
Stdev: 25.827 ms (1.4%)
Runs: 1833.2139080017805 1853.3035899996758 1866.026774995029 1872.4457199946046 1877.333904005587 1877.8173430040479 1878.8999840021133 1879.1403000056744 1880.3202729970217 1881.2448330000043 1881.6084400042892 1882.7340509966016 1883.6885179951787 1885.1001800000668 1888.8027760013938 1889.2445480003953 1889.4475519955158 1889.4665540009737 1889.8857019990683 1891.1507980003953 1891.992187999189 1892.0048030018806 1892.7340099960566 1893.39078900218 1894.3459890037775 1895.8581959977746 1896.6903899982572 1896.7111010029912 1896.9985359981656 1899.522339001298 1899.5891119986773 1899.8317470028996 1900.2066249996424 1901.7719319984317 1902.5876060053706 1903.703979998827 1904.2035329937935 1907.9944670051336 1909.2220879942179 1910.594319999218 1913.2938239946961 1916.2884529978037 1916.857301004231 1920.15010599792 1922.9982509985566 1923.4774179980159 1924.376709997654 1924.4412029981613 1929.503988005221 1929.9927589967847 1930.6965750008821 1930.9984950050712 1931.875854998827 1934.785767994821 1936.1622329950333 1949.2332370057702 1954.0788170024753 1961.0942400023341 1982.1025809943676

Current
Mean: 2056.969 ms
Stdev: 211.881 ms (10.3%)
Runs: 1822.3272719979286 1832.5961920022964 1861.2831230014563 1867.8900559991598 1868.0040289983153 1868.4572359994054 1870.2991550043225 1871.8498539999127 1872.55586899817 1872.977173998952 1877.4569500014186 1878.3017179965973 1880.5372729972005 1880.7404389977455 1881.5365820005536 1882.1877449974418 1886.4713139981031 1886.790528997779 1886.8921720013022 1886.9695640057325 1887.026733994484 1888.039186000824 1889.0123710036278 1889.5605879947543 1890.8214530050755 1891.6921389997005 1891.7382410019636 1892.1279710009694 1892.3194180056453 1893.6866870000958 1894.7966729998589 1895.0483400002122 1895.695597998798 1896.3827320039272 1896.79972499609 1899.960003003478 1900.255697004497 1900.3374439999461 1900.518230997026 1900.5626639947295 1900.820312999189 1903.5074469968677 1904.9036059975624 1905.652059994638 1906.6315929964185 1907.4161790013313 1909.5648609995842 1909.681763999164 1910.2242029979825 1911.5482189953327 1916.4333090037107 1917.5345060005784 1918.3796389997005 1925.2744550034404 1925.5290130004287 1926.157918997109 1926.1770849972963 1960.2629000023007 1961.1818039938807 1987.0479340031743 2138.346354998648 2209.490275993943 2254.084352001548 2260.705811999738 2281.1837169975042 2281.1839210018516 2285.9488539993763 2292.136231996119 2294.204793997109 2294.204793997109 2297.850547000766 2301.243817001581 2305.909953996539 2307.649862997234 2311.1518570035696 2312.8872490003705 2320.9914159998298 2324.625449001789 2329.439291998744 2329.6077490001917 2337.1943369954824 2339.314453996718 2340.0443940013647 2345.658041000366 2354.103556998074 2355.7419449985027 2355.7419449985027 2364.37589699775 2369.135091997683 2371.3221450001 2379.3537610024214 2394.5741790011525 2406.229411996901 2412.9742849990726 2423.779664002359 2430.2471529990435

Copy link
Contributor

Performance Comparison Report 📊 (2/3)

Meaningless Changes To Duration (1/2)

Show entries
Name Duration
App start time appCreation 89.695 ms → 91.417 ms (+1.722 ms, +1.9%)
App start time contentAppeared_To_screenTTI 1646.456 ms → 1640.506 ms (-5.950 ms, ±0.0%)
App start time nativeLaunchEnd_To_appCreationStart 112.650 ms → 114.817 ms (+2.167 ms, +1.9%)
App start time nativeLaunch 32.746 ms → 32.793 ms (+0.047 ms, ±0.0%)
App start time runJsBundle 449.617 ms → 447.983 ms (-1.633 ms, ±0.0%)
App start time regularAppStart 0.030 ms → 0.033 ms (+0.003 ms, +10.0%)
App start time appCreationEnd_To_contentAppeared 727.967 ms → 733.067 ms (+5.100 ms, +0.7%)
App start time TTI 2610.506 ms → 2613.356 ms (+2.850 ms, ±0.0%)
App start time (CPU) 151.543 % → 151.065 % (-0.478 %, ±0.0%)
App start time (FPS) 60.000 FPS → 60.000 FPS
App start time (RAM) 374.995 MB → 375.266 MB (+0.271 MB, ±0.0%)
App start time (CPU/JS) 0.000 % → 0.000 %
App start time (CPU/UI) 28.092 % → 28.364 % (+0.273 %, +1.0%)
Open search router TTI Load Search Options 289.380 ms → 284.411 ms (-4.969 ms, -1.7%)
Open search router TTI (CPU) 147.914 % → 148.306 % (+0.392 %, ±0.0%)
Open search router TTI (FPS) 60.000 FPS → 59.999 FPS (-0.001 FPS, ±0.0%)
Open search router TTI (RAM) 402.947 MB → 403.341 MB (+0.394 MB, ±0.0%)
Open search router TTI (CPU/JS) 0.000 % → 0.000 %
Open search router TTI (CPU/UI) 24.407 % → 24.822 % (+0.415 %, +1.7%)
Report typing Composer typing rerender count 1.000 renders → 1.000 renders
Report typing Message sent 922.998 ms → 915.277 ms (-7.720 ms, -0.8%)
Report typing (CPU) 115.992 % → 114.961 % (-1.031 %, -0.9%)
Report typing (FPS) 59.992 FPS → 59.978 FPS (-0.014 FPS, ±0.0%)
Report typing (RAM) 459.895 MB → 459.066 MB (-0.829 MB, ±0.0%)
Report typing (CPU/JS) 0.000 % → 0.000 %
Report typing (CPU/UI) 22.392 % → 22.470 % (+0.078 %, ±0.0%)
Chat opening Chat TTI 1112.968 ms → 1109.342 ms (-3.626 ms, ±0.0%)
Chat opening (CPU) 154.733 % → 155.332 % (+0.599 %, ±0.0%)
Chat opening (FPS) 59.968 FPS → 59.988 FPS (+0.020 FPS, ±0.0%)
Chat opening (RAM) 397.561 MB → 397.395 MB (-0.166 MB, ±0.0%)
Chat opening (CPU/JS) 0.000 % → 0.000 %
Chat opening (CPU/UI) 30.403 % → 30.361 % (-0.043 %, ±0.0%)
Money request - Open Manual Tracking 230.626 ms → 230.901 ms (+0.275 ms, ±0.0%)
Money request - Open Contacts 634.705 ms → 634.473 ms (-0.232 ms, ±0.0%)
Money request - Open Create 190.987 ms → 190.187 ms (-0.801 ms, ±0.0%)
Money request (CPU) 179.166 % → 179.733 % (+0.567 %, ±0.0%)
Money request (FPS) 58.160 FPS → 57.999 FPS (-0.161 FPS, ±0.0%)
Money request (RAM) 451.439 MB → 449.599 MB (-1.840 MB, ±0.0%)
Money request (CPU/JS) 0.000 % → 0.000 %
Money request (CPU/UI) 38.805 % → 39.073 % (+0.268 %, +0.7%)
Show details
Name Duration
App start time appCreation Baseline
Mean: 89.695 ms
Stdev: 14.102 ms (15.7%)
Runs: 60 64 65 66 70 70 71 73 73 75 75 76 76 78 79 81 83 83 83 84 85 85 85 87 88 88 88 89 90 90 91 91 92 93 93 95 95 95 95 95 96 97 97 97 97 97 99 101 102 103 103 104 109 111 114 114 115 119 122

Current
Mean: 91.417 ms
Stdev: 14.964 ms (16.4%)
Runs: 67 68 69 70 71 71 71 72 73 73 73 76 79 81 81 82 82 83 83 83 85 85 85 86 86 87 88 90 91 91 91 91 91 91 92 93 95 96 98 98 100 100 100 100 102 102 103 103 103 105 106 106 106 109 110 114 120 122 126 130
App start time contentAppeared_To_screenTTI Baseline
Mean: 1646.456 ms
Stdev: 427.329 ms (26.0%)
Runs: 599.9756750017405 773.3503710031509 774.9373779967427 788.023025996983 814.875229999423 851.5613249987364 915.6778699979186 1021.4414229989052 1157.808246999979 1230.1102200001478 1253.1647929996252 1333.1557670012116 1352.4671970009804 1370.7332329973578 1383.1423119977117 1401.9796990007162 1413.1069459989667 1418.4001569971442 1436.8453719988465 1437.1041100025177 1439.176968999207 1457.5990400016308 1472.0465120002627 1482.7761960029602 1485.558161996305 1486.948711000383 1694.5429800003767 1802.667978003621 1826.0860909968615 1829.2716230005026 1860.1731569990516 1881.946342997253 1925.624601997435 1950.331070996821 1954.6949670016766 1955.2346509993076 1970.5241530016065 1974.1593850031495 1974.8150760009885 1983.969875998795 1984.2201619967818 1984.8158349990845 1992.019212000072 1995.1755950003862 1998.6170890033245 2001.0048220008612 2001.5295059978962 2002.1424800008535 2008.3107229992747 2011.9947459995747 2019.1756860017776 2023.738030999899 2033.3981989994645 2044.3069680035114 2055.3634829968214 2058.6588120013475 2070.1663359999657 2086.27084299922 2089.924033999443 2190.4906719997525

Current
Mean: 1640.506 ms
Stdev: 422.700 ms (25.8%)
Runs: 651.937870003283 694.4851879999042 738.4111389964819 794.7153199985623 798.4398280009627 805.30103199929 911.0233869999647 1062.7136380001903 1224.565747000277 1245.288324996829 1298.876956999302 1318.1043260022998 1328.5426139980555 1360.7291110008955 1382.1652040034533 1417.27402099967 1447.3838090002537 1464.2279789969325 1464.6405420005322 1464.7691259980202 1466.7574229985476 1467.2134729996324 1484.2143919989467 1500.4304760023952 1505.917666003108 1513.7287779971957 1514.3097829967737 1792.3478849977255 1817.373612999916 1831.8721930012107 1837.6420079991221 1841.8780670017004 1848.9518970027566 1867.7129530012608 1889.3698439970613 1921.937366001308 1922.619099996984 1928.2926319986582 1933.9698529988527 1937.8306590020657 1959.4241309985518 1968.3240119963884 1973.6863830015063 1990.0318379998207 1999.441272996366 2009.881480999291 2021.075080998242 2029.5131879970431 2037.5700910016894 2038.4087689965963 2040.325320996344 2043.158292002976 2047.0875319987535 2058.4842450022697 2060.7040010020137 2063.222566999495 2071.4671410024166 2085.32579100132 2101.446425996721 2133.816595003009
App start time nativeLaunchEnd_To_appCreationStart Baseline
Mean: 112.650 ms
Stdev: 20.685 ms (18.4%)
Runs: 78 83 86 87 87 87 89 90 90 92 94 94 95 95 96 97 98 99 101 101 102 102 102 104 104 104 104 105 107 109 109 110 110 110 114 114 116 116 117 121 121 122 123 127 128 129 131 131 131 132 134 135 135 138 142 143 144 155 167 172

Current
Mean: 114.817 ms
Stdev: 19.772 ms (17.2%)
Runs: 79 82 84 86 88 89 89 90 90 92 98 100 100 100 101 102 102 103 103 104 104 104 106 108 109 109 110 110 111 111 111 112 114 115 115 116 119 119 120 120 123 124 124 126 127 129 131 136 137 138 139 142 144 144 145 145 147 152 153 158
App start time nativeLaunch Baseline
Mean: 32.746 ms
Stdev: 5.928 ms (18.1%)
Runs: 24 24 24 25 25 25 25 25 26 26 26 27 27 27 27 28 28 30 30 31 31 31 32 32 32 32 33 33 33 33 33 33 33 33 33 33 33 33 34 34 34 34 35 35 35 36 36 37 38 39 39 40 41 42 42 43 47 47 48

Current
Mean: 32.793 ms
Stdev: 5.445 ms (16.6%)
Runs: 24 24 25 26 26 26 26 27 27 27 27 27 28 28 28 29 29 30 31 31 31 31 31 31 31 32 32 32 32 32 32 32 32 33 33 34 34 34 35 35 35 35 36 36 36 37 37 37 38 39 40 40 40 41 41 45 46 48
App start time runJsBundle Baseline
Mean: 449.617 ms
Stdev: 75.292 ms (16.7%)
Runs: 298 298 301 301 302 302 313 313 335 335 342 342 352 352 364 364 366 366 367 367 367 367 369 369 370 370 371 371 373 373 384 384 385 385 387 387 396 396 396 396 404 404 404 404 418 418 418 418 421 421 429 429 471 471 484 484 484 484 485 485 486 486 487 487 487 487 489 489 491 491 491 491 491 491 496 496 498 498 500 500 504 504 504 504 505 505 506 506 506 506 513 513 517 517 517 517 524 524 524 524 527 527 527 527 530 530 530 530 531 531 533 533 544 544 544 544 553 553 566 566

Current
Mean: 447.983 ms
Stdev: 70.426 ms (15.7%)
Runs: 300 300 319 319 326 326 332 332 335 335 337 337 345 345 360 360 364 364 369 369 370 370 375 375 379 379 381 381 381 381 385 385 385 385 389 389 390 390 392 392 392 392 401 401 406 406 418 418 433 433 457 457 469 469 475 475 477 477 478 478 481 481 485 485 486 486 486 486 488 488 490 490 492 492 494 494 495 495 498 498 498 498 502 502 504 504 507 507 508 508 512 512 513 513 514 514 515 515 515 515 516 516 518 518 519 519 521 521 524 524 525 525 526 526 531 531 535 535 561 561
App start time regularAppStart Baseline
Mean: 0.030 ms
Stdev: 0.006 ms (20.8%)
Runs: 0.020101003348827362 0.020222999155521393 0.020385995507240295 0.020791999995708466 0.021118000149726868 0.022216998040676117 0.02237900346517563 0.022380001842975616 0.022501997649669647 0.022583000361919403 0.022867999970912933 0.02294900268316269 0.02294900268316269 0.022988997399806976 0.02364099770784378 0.023803994059562683 0.02404800057411194 0.025593996047973633 0.026041999459266663 0.026489004492759705 0.026854999363422394 0.027506999671459198 0.027709998190402985 0.030720993876457214 0.031168997287750244 0.03165599703788757 0.03165699541568756 0.03165700286626816 0.03169799596071243 0.03173799812793732 0.031940996646881104 0.03202299773693085 0.032145000994205475 0.03234899789094925 0.03251100331544876 0.03259199857711792 0.03267400711774826 0.03279600292444229 0.032836996018886566 0.03287799656391144 0.032958999276161194 0.03295900672674179 0.032999999821186066 0.033121004700660706 0.03385399281978607 0.034015998244285583 0.03409799933433533 0.03426100313663483 0.034383006393909454 0.035075001418590546 0.03544199466705322 0.036010995507240295 0.037271998822689056 0.03735300153493881 0.03910300135612488 0.03975500166416168 0.040202006697654724 0.04073100537061691 0.04394499957561493 0.046671003103256226

Current
Mean: 0.033 ms
Stdev: 0.005 ms (16.2%)
Runs: 0.021891005337238312 0.023273997008800507 0.02416999638080597 0.024779997766017914 0.02506500482559204 0.025593996047973633 0.02644900232553482 0.027506999671459198 0.027546994388103485 0.02771000564098358 0.028238996863365173 0.028400994837284088 0.028523996472358704 0.028767995536327362 0.02893099933862686 0.029012002050876617 0.029743999242782593 0.030233003199100494 0.030354999005794525 0.03088400512933731 0.031167998909950256 0.03149399906396866 0.0315760001540184 0.032023996114730835 0.03332500159740448 0.03360999375581741 0.03373199701309204 0.034585997462272644 0.03503499925136566 0.03511600196361542 0.03511600196361542 0.03556299954652786 0.035604000091552734 0.035725995898246765 0.03584799915552139 0.03588800132274628 0.03613299876451492 0.03633599728345871 0.037515997886657715 0.038005001842975616 0.03812699764966965 0.03816699981689453 0.0382080003619194 0.038777999579906464 0.03894100338220596 0.03898100554943085 0.03910300135612488 0.03934800624847412 0.039510004222393036 0.04052799940109253 0.04105599969625473 0.041951000690460205 0.04239899665117264 0.043049998581409454
App start time appCreationEnd_To_contentAppeared Baseline
Mean: 727.967 ms
Stdev: 115.272 ms (15.8%)
Runs: 495 501 503 532 539 547 561 575 594 605 606 624 624 625 628 628 629 647 662 665 682 687 693 703 708 745 751 751 752 755 760 763 765 770 772 776 787 788 789 794 795 801 801 805 805 810 810 815 817 817 820 820 822 862 875 899 900 936 937 950

Current
Mean: 733.067 ms
Stdev: 132.316 ms (18.0%)
Runs: 483 512 534 535 537 539 568 574 575 585 586 594 605 609 615 621 625 631 631 634 647 653 666 673 722 734 738 745 752 756 757 760 762 768 778 779 782 784 788 788 793 794 794 801 806 812 830 848 853 894 902 905 910 912 916 934 935 943 969 1008
App start time TTI Baseline
Mean: 2610.506 ms
Stdev: 536.807 ms (20.6%)
Runs: 1479.023025996983 1479.9756750017405 1567.9373779967427 1616.350371003151 1665.5613249987364 1761.6778699979186 1773.875229999423 1872.4414229989052 1941.1647929996252 1967.1102200001478 2041.4671970009804 2106.979699000716 2122.1557670012116 2153.400156997144 2180.1069459989667 2232.599040001631 2266.733232997358 2280.176968999207 2299.8453719988465 2300.1423119977117 2306.558161996305 2336.0465120002627 2339.1041100025177 2340.77619600296 2359.808246999979 2369.948711000383 2600.5429800003767 2925.667978003621 2926.331070996821 2972.6949670016766 2980.2346509993076 2981.946342997253 2990.624601997435 2992.004822000861 3000.2716230005026 3002.8158349990845 3012.3981989994645 3021.5241530016065 3024.969875998795 3027.1731569990516 3032.8150760009885 3036.529505997896 3044.0860909968615 3049.1593850031495 3056.9947459995747 3066.1424800008535 3071.019212000072 3079.220161996782 3082.6170890033245 3089.1756860017776 3091.924033999443 3106.3069680035114 3110.738030999899 3113.3634829968214 3117.3107229992747 3145.1755950003862 3149.1663359999657 3162.27084299922 3194.6588120013475 3211.4906719997525

Current
Mean: 2613.356 ms
Stdev: 547.841 ms (21.0%)
Runs: 1380.4851879999042 1507.411138996482 1517.4398280009627 1520.937870003283 1638.7153199985623 1650.30103199929 1703.0233869999647 1926.565747000277 1965.288324996829 2068.1043260023 2094.7136380001903 2116.5426139980555 2149.1652040034533 2189.27402099967 2248.3838090002537 2251.7574229985476 2255.2143919989467 2299.2279789969325 2308.640542000532 2315.76912599802 2335.917666003108 2337.876956999302 2338.2134729996324 2357.7287779971957 2366.7291110008955 2371.430476002395 2390.3097829967737 2923.6863830015063 2957.9698529988527 2964.3240119963884 2967.424130998552 2981.3478849977255 2988.292631998658 2997.8721930012107 3005.8780670017004 3006.158292002976 3026.9518970027566 3034.441272996366 3044.7129530012608 3045.881480999291 3052.4671410024166 3056.325320996344 3056.8306590020657 3061.0318379998207 3067.32579100132 3098.642007999122 3107.373612999916 3111.222566999495 3111.619099996984 3115.3698439970613 3123.5700910016894 3124.4842450022697 3125.513187997043 3127.937366001308 3129.7040010020137 3134.075080998242 3135.0875319987535 3158.446425996721 3170.816595003009 3183.4087689965963
App start time (CPU) Baseline
Mean: 151.543 %
Stdev: 6.421 % (4.2%)
Runs: 138.34975240693376 138.8594695421851 139.13670003136696 139.5323309811062 140.44569771899523 142.3065863648425 143.31985367211422 145.23578072463857 145.2732970883791 145.36479004428338 145.76185546531258 146.0574465127753 147.23333393333576 147.61705252018612 148.23383732755826 148.4921213319235 148.8300091813014 148.95623621057817 148.996378992038 149.13865142067544 149.14425559016198 149.3361723446894 149.37774133953303 149.62661809139095 149.86082521230824 150.0112459035048 150.61955540919956 150.6450975095407 151.5166477695371 151.5423152540886 153.028784828895 153.1190161143035 153.30498227192757 153.32569443505756 153.77384451614816 153.89415247881783 154.08954312327847 154.46772288192437 155.15328354958723 155.17230285576525 155.52841484924485 155.54806000346565 155.70715654312653 155.79635683030918 155.94183872009455 156.19718457000542 156.5189619708686 156.78749868618473 157.50874324203295 157.86980033051844 159.7454671842404 160.32676468184945 160.60936742358467 161.48517528790475 162.62368515356562 165.60577453443014 165.98936514171336

Current
Mean: 151.065 %
Stdev: 4.840 % (3.2%)
Runs: 140.04281143646452 140.77832160063747 141.0806132380409 142.36316619193872 143.40761340298732 143.7593497330158 145.17823571409605 146.53242298871623 146.97897579173727 147.3524584443391 147.79985598784262 148.4990473306088 148.72455249792637 148.96385288941144 148.97860109447936 149.12528782145736 149.3346915945586 149.39164876537063 149.6322295934535 149.7059265692725 149.718738826423 149.77083625925312 150.35605735456397 150.4499035627404 150.71255296890672 150.7728422384299 150.80166758117238 151.060093999736 151.165461606951 151.41053655172797 151.45908925683565 151.6339450382964 152.96005041520573 153.16389058206838 153.37347880595215 153.44777485434216 153.49899735423173 153.5596171586754 153.56016291810394 154.4312197244319 154.70547280110077 154.7513236556615 155.23226037526882 155.392728550235 155.4544088867197 155.583996206 156.16744711592145 156.6886851654063 157.1301186197197 158.35697284881778 158.80412693499682 159.48812504822226 163.75069074628755
App start time (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
App start time (RAM) Baseline
Mean: 374.995 MB
Stdev: 5.518 MB (1.5%)
Runs: 361.53125 363.31640625 364.2877604166667 364.84375 365.3515625 366.64453125 369.0026041666667 369.2939453125 369.4876302083333 369.74609375 369.8134765625 371.58203125 371.634765625 371.8860677083333 371.896484375 371.919921875 371.9443359375 372.17578125 372.3424479166667 372.76796875 372.869140625 373.84765625 374.201171875 374.4290364583333 374.5734375 374.7359375 375.0963541666667 375.1588541666667 375.2415364583333 375.5305989583333 375.6751302083333 375.6959635416667 376.16015625 376.552734375 376.5885416666667 376.716796875 376.9381510416667 377.39453125 377.412109375 377.5598958333333 377.66796875 378.5693359375 378.9453125 379.3958333333333 379.974609375 380.255859375 380.2623697916667 380.318359375 380.4479166666667 380.9401041666667 381.140625 381.2493489583333 381.6240234375 383.2864583333333 383.4251302083333 386.0078125 387.3857421875

Current
Mean: 375.266 MB
Stdev: 4.891 MB (1.3%)
Runs: 362.9544270833333 366.896484375 367.3372395833333 367.9619140625 368.2213541666667 368.498046875 369.6298828125 370.19140625 371.404296875 371.5625 371.7099609375 372.06875 372.078125 372.3447265625 372.599609375 372.72265625 372.7298177083333 372.8837890625 373.1318359375 373.265625 373.423828125 373.6295572916667 373.98828125 374.017578125 374.123046875 374.27734375 374.3828125 374.4544270833333 374.9150390625 375.28125 375.3802083333333 375.6588541666667 375.72265625 376.6927083333333 376.736328125 376.794921875 376.8489583333333 376.974609375 377.2135416666667 377.9752604166667 377.9817708333333 378.419921875 378.59375 378.7220052083333 379.8899739583333 380.6614583333333 380.9518229166667 381.0481770833333 381.0729166666667 381.4694010416667 381.7431640625 382.2392578125 382.8587239583333 387.3919270833333 387.9052734375
App start time (CPU/JS) Baseline
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

Current
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
App start time (CPU/UI) Baseline
Mean: 28.092 %
Stdev: 2.521 % (9.0%)
Runs: 21.8 23 23.3 23.9 24 24.8 25.1 25.2 25.4 25.5 25.5 25.9 26 26 26.1 26.4 26.4 26.5 26.8 27 27.3 27.4 27.5 27.5 27.9 27.9 27.9 28.1 28.2 28.3 28.5 28.6 28.8 29 29 29 29 29.2 29.2 29.3 29.5 29.6 29.6 29.6 29.7 29.7 29.9 30.2 30.3 30.4 30.4 31.4 31.4 31.5 31.9 31.9 32.5 32.6 33.1

Current
Mean: 28.364 %
Stdev: 2.383 % (8.4%)
Runs: 23 24.2 24.9 25 25.3 25.4 25.5 25.5 25.5 25.6 25.7 25.9 26 26 26 26.1 26.4 26.6 26.9 27.2 27.3 27.4 27.7 28.3 28.3 28.4 28.5 28.5 28.6 28.7 28.7 28.8 28.8 28.9 28.9 28.9 28.9 29.1 29.2 29.2 29.4 29.6 29.7 29.9 30 30 30.3 30.5 30.6 30.7 31 31.2 31.6 31.7 31.8 32.2 32.9 33.1 33.5
Open search router TTI Load Search Options Baseline
Mean: 289.380 ms
Stdev: 1.959 ms (0.7%)
Runs: 285.1005459949374 285.1177570000291 285.9130860045552 285.9259850010276 286.69246400147676 286.7408849969506 286.9351399987936 287.612873993814 287.63187699764967 287.72578900307417 287.7331549972296 287.79520700126886 287.85677099972963 288.0647379979491 288.0961100012064 288.29960100352764 288.4989829957485 288.59631299972534 288.61385099589825 288.67427599430084 288.7268880009651 288.7404379993677 288.8793129995465 288.9452719986439 288.98795499652624 289.0114750042558 289.06388399749994 289.068970002234 289.1589360013604 289.1774910017848 289.1801750063896 289.33174700289965 289.3997800052166 289.43599500507116 289.48946099728346 289.56172700226307 289.90909899771214 289.99125099927187 290.1581219956279 290.1817630007863 290.4051919952035 290.4699710011482 290.47013399749994 290.5530189946294 290.6379799991846 290.96736700087786 291.0132649987936 291.1334230005741 291.5758059993386 291.65031000226736 291.7965909987688 292.0863449946046 292.1158449947834 292.1833500042558 292.5074060037732 292.8007000014186 293.2073969990015 294.4268800020218

Current
Mean: 284.411 ms
Stdev: 2.212 ms (0.8%)
Runs: 279.22220899909735 280.4677329957485 281.0445149987936 281.0941569954157 281.3195800036192 281.66573099792004 282.02262400090694 282.04325400292873 282.09704599529505 282.37475600093603 282.4699710011482 282.5186769962311 282.5914310067892 282.63525400310755 282.84590700268745 282.8921310007572 282.9556069970131 282.9665120020509 283.003783993423 283.01586899906397 283.32124800235033 283.4424240067601 283.7186280041933 283.9449879974127 283.9547530040145 284.00008099526167 284.02172899991274 284.0338950008154 284.06449399888515 284.20247399806976 284.32983399927616 284.3736159950495 284.52986700087786 284.5650640055537 284.61560100317 284.8266599997878 284.83451300114393 284.9512119963765 285.0178229957819 285.0662440061569 285.0830080062151 285.12980200350285 285.2319749966264 285.37272100150585 285.6466879993677 285.76733399927616 286.0225830003619 286.1776119992137 286.30664099752903 286.4974780008197 286.7860110029578 287.0658769980073 287.1256919950247 287.53633699566126 287.9078770056367 288.12373799830675 288.5122880041599 288.66385900229216 288.71822099387646 289.8955079987645
Open search router TTI (CPU) Baseline
Mean: 147.914 %
Stdev: 3.200 % (2.2%)
Runs: 140.370905094894 140.95156388862722 141.2860850415847 142.11024125865225 142.46990882280352 143.1704745263235 143.34048809525407 143.4121858146923 143.8690407185767 143.8801672225753 143.95728367573165 144.65410192441846 144.84485326992336 145.20580661000315 145.4698937350442 145.48526177333585 146.02173367780543 146.89088078253235 147.02941164357617 147.10314279184493 147.25782055793093 147.55456179470656 147.61438415665557 147.72046940109243 147.76898935807804 147.92014588453904 148.11075915811816 148.12063002970285 148.20624105703922 148.33842939681253 148.63445723694056 148.808937160602 149.26286049716097 149.37102945001567 149.53389106421307 149.53484891107703 149.5391022281743 149.54277995789192 149.61018409548063 149.70277046683393 149.83149613357273 149.83584055650797 149.92311602245323 149.94793451143704 149.98286376808142 150.02317639832754 150.06699978059333 150.6159616426257 150.61767861770286 150.93900844147345 150.9830312522765 151.02964366539348 151.093805119405 151.38614461486097 151.69000143213754 151.85399411216736 152.12866243861063 152.81777522856572 153.13826512591308 153.26519180115181

Current
Mean: 148.306 %
Stdev: 3.474 % (2.3%)
Runs: 140.1678187224994 141.05705213171453 141.16681989720377 141.5443436363184 141.96170435246214 143.2446208107314 143.42623771888782 143.66336209917546 144.02653923177004 144.5804502961086 144.6764813426634 145.2123318367418 145.88115748939487 145.9791320003134 146.1319157960627 146.1360440954785 146.43631000812744 146.6280598505335 146.7990245778549 146.96231559777172 147.32889824222582 147.57334364193278 147.5953578851195 147.64866372860726 147.75553049440893 148.2227010637461 148.2366487206154 148.3784605760513 148.63003661768056 148.67629125513108 148.687659434624 148.8819018122366 149.02418066586947 149.0386755050534 149.05884718135837 149.07218236866765 149.738927459599 149.8905540223523 150.0028094842829 150.1570434719387 150.46875306911275 150.65726681476193 150.8393571704615 150.92644523621956 150.93708288413154 151.09872690570478 151.18537272711552 151.25009849526057 151.40090240951108 151.4441425595916 151.73022732055395 151.84055835212843 152.06634864326995 152.12682307593323 152.18390197143714 152.79567864878243 153.45796191101186 154.0973818979882 154.29559525478052 154.3001927106435
Open search router TTI (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 59.999 FPS
Stdev: 0.008 FPS (0.0%)
Runs: 59.94236274773031 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Open search router TTI (RAM) Baseline
Mean: 402.947 MB
Stdev: 2.808 MB (0.7%)
Runs: 397.73741319444446 398.4973958333333 398.7903645833333 399.140625 399.37578125 399.37934027777777 399.47743055555554 399.58671875 399.62578125 399.6506076388889 399.75234375 399.9505208333333 400.13237847222223 400.132421875 400.5359375 400.5885416666667 400.784765625 400.907421875 401.019140625 401.152734375 401.364453125 401.410546875 401.84375 401.86015625 402.43446180555554 402.553125 402.6375 402.819140625 403.0078125 403.26875 403.3265625 403.366796875 403.409375 403.42578125 403.569140625 403.739453125 403.74375 403.853515625 404.0140625 404.280859375 404.305859375 404.355859375 404.78671875 404.998046875 405.096875 405.1859375 405.2859375 405.378125 406.0390625 406.104296875 406.21484375 406.218359375 406.333203125 406.507421875 407.417578125 407.53984375 407.5546875 408.27578125 410.115234375

Current
Mean: 403.341 MB
Stdev: 2.769 MB (0.7%)
Runs: 398.151171875 398.5607638888889 398.7942708333333 398.873046875 398.948828125 399.492578125 400.01996527777777 400.223828125 400.2981770833333 400.40928819444446 400.4625 400.56484375 400.6510416666667 400.68515625 400.701171875 400.790625 401.3875 401.4166666666667 401.55121527777777 401.682421875 401.855078125 402.012890625 402.205078125 402.419921875 402.45 402.5921875 402.97890625 402.99609375 403.30625 403.590234375 403.6203125 403.73359375 403.809375 404.0578125 404.091015625 404.116796875 404.20078125 404.5724826388889 404.6296875 404.6375 404.715625 404.785546875 405.121875 405.258984375 405.28428819444446 405.30703125 405.365234375 405.501171875 405.6232638888889 406.437109375 406.599609375 406.763671875 407.1234375 407.233984375 407.30546875 407.33125 407.929296875 408.037890625 408.13359375 409.04609375
Open search router TTI (CPU/JS) Baseline
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

Current
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Open search router TTI (CPU/UI) Baseline
Mean: 24.407 %
Stdev: 1.166 % (4.8%)
Runs: 22.2 22.6 22.7 22.7 22.8 23 23.1 23.2 23.3 23.3 23.4 23.4 23.5 23.5 23.6 23.6 23.7 23.7 23.7 23.8 23.8 23.9 23.9 23.9 23.9 23.9 23.9 24 24 24 24.1 24.1 24.2 24.4 24.5 24.5 24.6 24.6 24.8 24.8 24.9 24.9 25 25.1 25.1 25.2 25.4 25.4 25.4 25.5 25.6 26.1 26.1 26.3 26.3 26.4 26.5 26.7 26.7 27.2

Current
Mean: 24.822 %
Stdev: 1.222 % (4.9%)
Runs: 22.2 22.3 22.5 22.5 22.6 23.2 23.3 23.4 23.7 23.8 23.9 23.9 23.9 24 24.1 24.1 24.3 24.3 24.3 24.3 24.4 24.4 24.5 24.5 24.5 24.6 24.7 24.7 24.8 24.8 24.9 24.9 24.9 25 25 25.1 25.2 25.2 25.3 25.3 25.3 25.3 25.3 25.5 25.5 25.6 25.7 25.7 25.9 26.2 26.4 26.5 26.7 26.7 26.7 26.7 26.9 27.1 27.5
Report typing Composer typing rerender count Baseline
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

Current
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

Copy link
Contributor

Performance Comparison Report 📊 (3/3)

Meaningless Changes To Duration (2/2)

Show entries
Name Duration
App start time appCreation 89.695 ms → 91.417 ms (+1.722 ms, +1.9%)
App start time contentAppeared_To_screenTTI 1646.456 ms → 1640.506 ms (-5.950 ms, ±0.0%)
App start time nativeLaunchEnd_To_appCreationStart 112.650 ms → 114.817 ms (+2.167 ms, +1.9%)
App start time nativeLaunch 32.746 ms → 32.793 ms (+0.047 ms, ±0.0%)
App start time runJsBundle 449.617 ms → 447.983 ms (-1.633 ms, ±0.0%)
App start time regularAppStart 0.030 ms → 0.033 ms (+0.003 ms, +10.0%)
App start time appCreationEnd_To_contentAppeared 727.967 ms → 733.067 ms (+5.100 ms, +0.7%)
App start time TTI 2610.506 ms → 2613.356 ms (+2.850 ms, ±0.0%)
App start time (CPU) 151.543 % → 151.065 % (-0.478 %, ±0.0%)
App start time (FPS) 60.000 FPS → 60.000 FPS
App start time (RAM) 374.995 MB → 375.266 MB (+0.271 MB, ±0.0%)
App start time (CPU/JS) 0.000 % → 0.000 %
App start time (CPU/UI) 28.092 % → 28.364 % (+0.273 %, +1.0%)
Open search router TTI Load Search Options 289.380 ms → 284.411 ms (-4.969 ms, -1.7%)
Open search router TTI (CPU) 147.914 % → 148.306 % (+0.392 %, ±0.0%)
Open search router TTI (FPS) 60.000 FPS → 59.999 FPS (-0.001 FPS, ±0.0%)
Open search router TTI (RAM) 402.947 MB → 403.341 MB (+0.394 MB, ±0.0%)
Open search router TTI (CPU/JS) 0.000 % → 0.000 %
Open search router TTI (CPU/UI) 24.407 % → 24.822 % (+0.415 %, +1.7%)
Report typing Composer typing rerender count 1.000 renders → 1.000 renders
Report typing Message sent 922.998 ms → 915.277 ms (-7.720 ms, -0.8%)
Report typing (CPU) 115.992 % → 114.961 % (-1.031 %, -0.9%)
Report typing (FPS) 59.992 FPS → 59.978 FPS (-0.014 FPS, ±0.0%)
Report typing (RAM) 459.895 MB → 459.066 MB (-0.829 MB, ±0.0%)
Report typing (CPU/JS) 0.000 % → 0.000 %
Report typing (CPU/UI) 22.392 % → 22.470 % (+0.078 %, ±0.0%)
Chat opening Chat TTI 1112.968 ms → 1109.342 ms (-3.626 ms, ±0.0%)
Chat opening (CPU) 154.733 % → 155.332 % (+0.599 %, ±0.0%)
Chat opening (FPS) 59.968 FPS → 59.988 FPS (+0.020 FPS, ±0.0%)
Chat opening (RAM) 397.561 MB → 397.395 MB (-0.166 MB, ±0.0%)
Chat opening (CPU/JS) 0.000 % → 0.000 %
Chat opening (CPU/UI) 30.403 % → 30.361 % (-0.043 %, ±0.0%)
Money request - Open Manual Tracking 230.626 ms → 230.901 ms (+0.275 ms, ±0.0%)
Money request - Open Contacts 634.705 ms → 634.473 ms (-0.232 ms, ±0.0%)
Money request - Open Create 190.987 ms → 190.187 ms (-0.801 ms, ±0.0%)
Money request (CPU) 179.166 % → 179.733 % (+0.567 %, ±0.0%)
Money request (FPS) 58.160 FPS → 57.999 FPS (-0.161 FPS, ±0.0%)
Money request (RAM) 451.439 MB → 449.599 MB (-1.840 MB, ±0.0%)
Money request (CPU/JS) 0.000 % → 0.000 %
Money request (CPU/UI) 38.805 % → 39.073 % (+0.268 %, +0.7%)
Show details
Name Duration
Report typing Message sent Baseline
Mean: 922.998 ms
Stdev: 56.235 ms (6.1%)
Runs: 795.9549969956279 796.6780200004578 804.1457929983735 805.1087239980698 816.540974996984 822.5827639997005 835.4066980034113 835.7765310034156 840.1823729947209 852.5157880038023 856.8524169996381 872.3992110043764 872.5185150057077 873.3729249984026 875.2611500024796 875.83435100317 890.7013349980116 892.6494139954448 901.8318689987063 911.4644780009985 911.6544189974666 912.0668140053749 921.8140870034695 922.6949879974127 941.5133470073342 943.625326000154 944.8138020038605 952.9884449988604 955.3889570012689 955.954346999526 956.979044996202 957.7294109985232 957.8763839974999 958.3859869986773 958.970174998045 960.3692220002413 961.1601969972253 961.3309739977121 962.8467210009694 962.913290001452 963.3081870004535 963.7708339989185 964.0094820037484 964.2841800004244 965.5520839989185 966.5071209967136 966.7264819964767 966.8146160021424 966.9737139940262 967.3071290031075 967.7937429994345 968.2748619988561 968.3584389984608 969.8800050020218 971.8278819993138 972.8899339959025 976.616741001606 976.9042159989476 979.964274995029 983.2373050004244

Current
Mean: 915.277 ms
Stdev: 55.606 ms (6.1%)
Runs: 788.963216997683 794.7335209995508 806.4733080044389 814.025431998074 814.2060139998794 814.5598149970174 826.8670249953866 828.7235919982195 832.3409840017557 841.6556399986148 843.8822429999709 853.269205994904 863.503824993968 870.7293300032616 875.3984789997339 876.7304690033197 878.3214929997921 884.9187010005116 886.7768969982862 892.1477869972587 893.0554609969258 894.2631439939141 916.2279059961438 916.4097900018096 924.9697680026293 928.4842530041933 931.5484220013022 941.1008299961686 944.4431969970465 946.2708339989185 947.7572839930654 947.9447429999709 948.8495699986815 950.258910998702 952.8258880004287 953.7873539999127 954.6086430028081 955.4617929980159 956.0450039952993 957.6728520020843 957.7681889981031 957.8584799990058 958.7558190003037 959.053671002388 959.0614020004869 959.1501470059156 960.0634770020843 960.1137290000916 960.3233240023255 961.2729090005159 961.3343919962645 963.5416669994593 964.7507329955697 964.885009996593 965.9148760065436 966.1689860001206 966.4506839960814 967.3016360029578 974.891153998673 977.7604570016265
Report typing (CPU) Baseline
Mean: 115.992 %
Stdev: 4.020 % (3.5%)
Runs: 107.46044088942 109.64397983897277 110.10586915906866 110.7254391453038 110.7812782875139 110.88108853918916 110.95248316362449 111.12981245595805 111.54339091998165 111.55722200680543 111.62509722731039 111.74308723643324 112.38589779958687 112.45548646367877 112.59116972623681 112.66215081490999 112.81717473148751 112.86701656533195 113.41759945205334 113.63386980826957 113.66210504671122 113.71649055516029 113.76803831088382 114.03378233940553 114.90867022807393 115.45039525312706 115.45990083842716 115.57697526878292 115.79904226925846 115.83153054486118 115.91596710078923 115.96252695653044 116.73770352274013 116.80580210052872 117.04574678742277 117.16688842510281 117.44786153475528 117.96924420904571 118.06311371835228 118.19953715372348 118.42237169598447 118.75746445255847 119.03653455416959 119.1013438801524 119.28277176903354 119.52242991017468 119.61670141184415 119.90184988421333 120.31260018248217 120.32432398679462 120.62152521512704 120.8395457214771 121.27791319179171 121.40389480189472 121.52394153084875 121.58206115153584 122.03030386195212 123.42697574368455 126.0564728250773

Current
Mean: 114.961 %
Stdev: 3.948 % (3.4%)
Runs: 105.57030233009053 107.29151322157988 107.5964052443173 109.11335592018503 109.6718389463761 109.83817769027621 110.01113192641448 110.13826857902839 110.22356782244938 110.65338681221236 110.74494804432493 111.1689234501338 111.41822046537773 111.65391080924977 111.7966799082069 111.94431934802954 112.00084205070846 112.16466547258206 112.75920005576965 112.77552064972744 113.08159332289323 113.08209749888827 113.61396880859918 113.75187292733972 114.68182059874773 114.82600298508125 115.03765188629056 115.08457314529952 115.67944572597337 115.73247995289832 116.02666086746842 116.05341557425527 116.06216279019995 116.17799172112585 116.60349824339397 116.66018568411484 116.86367626882263 116.9191993349037 116.98141008559786 117.61753984874822 117.7962103135255 117.84630578256063 117.84833767312874 118.0253221122604 118.22525467147794 118.30478264876187 118.38168189195412 118.64095458109934 118.82277858777377 119.57694416750535 119.73512946583718 119.73749744282493 119.74032234347565 120.22059658236799 120.37287881108513 121.27882938997966 121.56697921107495 122.5441726303712
Report typing (FPS) Baseline
Mean: 59.992 FPS
Stdev: 0.019 FPS (0.0%)
Runs: 59.928991026420235 59.929650387599814 59.9359442769994 59.94699534162966 59.95365474659981 59.967759102985404 59.974321480878935 59.97449591619051 59.97476600415292 59.99278639983767 59.999517751447975 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 59.978 FPS
Stdev: 0.052 FPS (0.1%)
Runs: 59.809471360910905 59.81581568251278 59.82868726752564 59.869953137519865 59.874267785362 59.89440611040214 59.92020333795835 59.92027371006509 59.933803504611504 59.99848281724068 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Report typing (RAM) Baseline
Mean: 459.895 MB
Stdev: 3.750 MB (0.8%)
Runs: 450.6255580357143 451.07625 452.3470982142857 453.82310267857144 454.51729910714283 454.7691127232143 455.4849330357143 456.51353236607144 456.56905691964283 456.615162037037 456.8364955357143 456.8970424107143 457.05024245689657 457.2802734375 457.29603794642856 457.3794642857143 457.45772879464283 457.52036830357144 457.59458705357144 457.6410435267857 457.7666015625 458.09078663793105 458.3853717672414 458.61342075892856 458.81068638392856 458.82798549107144 459.00484913793105 459.56961495535717 459.95200892857144 460.15611049107144 460.2358566810345 460.60337611607144 460.8038793103448 461.11160714285717 461.171875 461.375 461.46902901785717 461.53236607142856 461.650390625 461.8285435267857 461.91615513392856 461.9168911637931 462.25111607142856 462.5972377232143 462.69698660714283 462.7407058189655 462.90792410714283 463.1640625 463.2726293103448 463.43973214285717 463.47739955357144 463.8526141826923 464.0001346982759 464.0131138392857 464.55245535714283 464.6831752232143 464.80078125 465.63197544642856 465.7603236607143 469.765234375

Current
Mean: 459.066 MB
Stdev: 2.830 MB (0.6%)
Runs: 452.75111607142856 453.83119419642856 454.41573660714283 454.53111049107144 455.39425223214283 455.4485452586207 455.48507254464283 456.0728236607143 456.36690848214283 456.54337284482756 456.79813058035717 456.80691964285717 457.02855603448273 457.2074497767857 457.2406529017857 457.35546875 457.4056919642857 457.5288783482143 457.5698939732143 457.60909598214283 457.65053013392856 457.8295200892857 457.908130787037 458.4318426724138 458.4488002232143 458.4849330357143 458.716796875 458.74609375 458.93624441964283 459.0162984913793 459.0944733796296 459.2709263392857 459.3062220982143 459.5751953125 459.7099609375 459.84458705357144 460.2667025862069 460.7113560267857 460.82421875 460.8295200892857 460.92632004310343 461.0693359375 461.29701450892856 461.3431919642857 461.4228515625 461.640625 461.875 462.38853236607144 462.4722377232143 462.47377232142856 462.81849888392856 462.88839285714283 463.26841517857144 463.63267299107144 464.75925925925924 466.41043526785717
Report typing (CPU/JS) Baseline
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

Current
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Report typing (CPU/UI) Baseline
Mean: 22.392 %
Stdev: 0.850 % (3.8%)
Runs: 20.4 20.5 20.9 20.9 21 21 21.2 21.4 21.5 21.5 21.6 21.6 21.6 21.8 21.9 21.9 22 22 22.1 22.1 22.2 22.2 22.2 22.3 22.4 22.4 22.4 22.4 22.4 22.5 22.5 22.5 22.5 22.5 22.5 22.6 22.6 22.6 22.6 22.7 22.7 22.8 22.8 23 23 23.1 23.1 23.2 23.3 23.3 23.4 23.5 23.5 23.6 23.6 23.7 23.8 23.9 23.9

Current
Mean: 22.470 %
Stdev: 0.747 % (3.3%)
Runs: 20.7 20.8 20.9 21.1 21.3 21.4 21.4 21.7 21.7 21.8 21.9 21.9 21.9 22 22 22 22 22.1 22.1 22.3 22.3 22.3 22.4 22.5 22.5 22.5 22.6 22.6 22.6 22.6 22.6 22.7 22.7 22.7 22.8 22.8 22.8 22.8 22.9 22.9 23 23 23 23 23.1 23.1 23.2 23.2 23.3 23.3 23.3 23.3 23.3 23.6 23.9 24.1
Chat opening Chat TTI Baseline
Mean: 1112.968 ms
Stdev: 18.670 ms (1.7%)
Runs: 1082.7611500024796 1086.5652270019054 1088.7482909932733 1090.7495529949665 1091.1716320067644 1091.8395190015435 1092.2008870020509 1093.7775470018387 1093.7808850035071 1094.0300699993968 1094.1761069968343 1096.3801269978285 1096.3922940045595 1096.4688720032573 1098.1312270015478 1099.1742760017514 1099.6370040029287 1100.0295820012689 1100.8520510047674 1101.6078290045261 1101.6656910032034 1102.2331549972296 1102.5077319964767 1103.1494560018182 1103.582439005375 1107.750854998827 1110.8800460025668 1112.6898200064898 1112.803468003869 1113.0334070026875 1113.6278899982572 1114.7573650032282 1115.7134200036526 1116.768148995936 1117.8085940033197 1118.6656090021133 1119.3310960009694 1119.6726490035653 1121.2396660000086 1122.3059089928865 1122.492757998407 1123.969117000699 1130.9796549975872 1132.0903730019927 1132.1093759983778 1133.140992000699 1136.9584970027208 1138.214803993702 1140.2201339975 1140.4672449976206 1142.6614179983735 1144.0607510060072 1148.8729249984026 1151.336061000824 1156.9960939958692

Current
Mean: 1109.342 ms
Stdev: 19.493 ms (1.8%)
Runs: 1071.3575449958444 1082.5146899968386 1083.478597998619 1087.60599899292 1087.9281009957194 1087.983846001327 1089.6639000028372 1089.9288329929113 1090.5604659989476 1090.582804992795 1091.4868979975581 1091.7963059991598 1092.4871430024505 1092.5629479959607 1093.168661005795 1094.979044996202 1095.3272709995508 1099.776042997837 1099.838093996048 1100.6533199995756 1101.4667569994926 1102.5482989996672 1105.3213710039854 1106.7781990021467 1106.9284669980407 1107.1763919964433 1107.3915610015392 1108.3163660019636 1108.9617119953036 1111.2213549986482 1112.0666100010276 1115.570069000125 1115.9932459965348 1116.5177410021424 1116.694173000753 1119.1636970043182 1119.4804700016975 1119.623740002513 1120.198038995266 1120.3745930045843 1123.8636889979243 1125.6271160021424 1126.3056640028954 1127.6645110026002 1128.1484779939055 1141.0446380004287 1145.196451999247 1145.2321369946003 1147.8057870045304 1154.7012939974666 1155.3623050004244
Chat opening (CPU) Baseline
Mean: 154.733 %
Stdev: 3.978 % (2.6%)
Runs: 144.91281239655672 145.392382694801 146.1596684279325 146.6983035258343 149.27882181712295 149.5618359780189 149.9291370492191 149.98496125544452 150.0677240531035 151.3013683469714 151.74113988170842 151.91389137850382 152.24459381973034 152.32861800019367 152.34371506287596 152.47709822796804 152.64182321766623 152.79502552130725 152.9244532751892 153.07064949793656 153.15569790330173 153.45952259981422 153.52091491787854 153.8486124927788 153.97998517674537 154.11988654646652 154.35732542334515 154.5875328847181 154.79120692404044 154.9587198798006 155.32002206694446 155.32636775740937 155.65427977460482 155.6714020877246 156.18822020713267 156.24003794387013 156.3539357745594 156.38297000632187 156.45638099701432 156.79537541372318 157.50988195972621 157.9074963732421 157.98761202744484 158.0831119585088 158.08777859742398 158.08860348668944 158.14985708964562 158.97108467209665 159.50355180068004 159.59185407988255 159.70562402917378 159.91876580777523 160.02992477373508 160.0596666942689 160.078440583719 160.39559885034313 160.56241832471443 160.96581018138886

Current
Mean: 155.332 %
Stdev: 4.275 % (2.8%)
Runs: 146.17462978942876 146.60270571119457 147.35972831171185 147.61174823419407 147.98575809284299 148.2271935499616 148.29845834358892 149.71149414442573 150.22536661891863 150.33111938299427 150.5729785350606 150.8768238833573 152.65945585691603 152.76213635572205 152.94023444824947 152.98035986388996 153.64079938923896 153.80807083614687 154.17691045557166 154.56791646857326 154.7185050576627 154.77729710078913 154.831362338643 154.92969616322918 154.93284937799146 155.19344772148446 155.36966915280172 155.69509911010078 155.69637101285863 155.69656741482774 156.05647182635468 156.33445228707845 156.34380544295252 156.43458113796314 156.5275551392303 156.90203551735536 156.91246653562618 157.26365000583934 157.33992663516722 157.43822391536045 157.91706060936147 158.03433243286293 158.1066630865693 158.27985540848272 158.4165988349841 158.55755278868426 158.58430273690954 158.91072247419186 159.56108702297016 159.78080691096397 159.86162257736115 160.0981015612542 160.47739750093334 161.1462669544383 161.16079246873062 161.34132713515768 162.5939034616014 165.5250619702075
Chat opening (FPS) Baseline
Mean: 59.968 FPS
Stdev: 0.070 FPS (0.1%)
Runs: 59.747896437586746 59.750950211530295 59.77306869884555 59.80072427181489 59.83282029441617 59.85852246644044 59.87566764162663 59.90607545131387 59.91343439007365 59.940153858013026 59.980415678938115 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 59.988 FPS
Stdev: 0.039 FPS (0.1%)
Runs: 59.816548697523075 59.83108640840079 59.89332947941417 59.9505338945813 59.96745725412164 59.96941527662135 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Chat opening (RAM) Baseline
Mean: 397.561 MB
Stdev: 4.264 MB (1.1%)
Runs: 387.75 387.75390625 388.41171875 388.6627604166667 389.3771701388889 391.02734375 391.27064732142856 392.2294921875 392.50830078125 392.54443359375 393.03271484375 393.1388888888889 393.55322265625 393.70947265625 394.2834201388889 394.28515625 395.0087890625 395.03125 395.58246527777777 395.7018229166667 396.71397569444446 397.01215277777777 397.26953125 397.72222222222223 398.0091145833333 398.2747395833333 398.8515625 398.9622395833333 398.98133680555554 399.07899305555554 399.0954861111111 399.1467013888889 399.36675347222223 399.37586805555554 399.4982638888889 399.7638888888889 399.7682291666667 399.83897569444446 400.03993055555554 400.1310763888889 400.3697916666667 400.4748263888889 400.4765625 400.72569444444446 400.82421875 400.87847222222223 401.0412326388889 401.16449652777777 401.2473958333333 401.5334201388889 401.55815972222223 401.8515625 401.85633680555554 401.98090277777777 402.1032986111111 402.2248263888889 402.30859375 402.56727430555554 402.63368055555554 404.0989583333333

Current
Mean: 397.395 MB
Stdev: 4.315 MB (1.1%)
Runs: 384.1901041666667 388.4888392857143 388.80636160714283 390.65478515625 391.26025390625 391.69921875 392.0954861111111 392.52294921875 392.583984375 392.6904296875 393.1923828125 393.44775390625 393.58642578125 394.05902777777777 394.08056640625 394.14599609375 394.31597222222223 394.85460069444446 395.9427083333333 396.1150173611111 396.154296875 396.609375 397.13671875 397.875 397.9010416666667 398.09375 398.18012152777777 398.20355902777777 398.26953125 398.43836805555554 399.0529513888889 399.1341145833333 399.15972222222223 399.5837673611111 399.62109375 399.6236979166667 399.7734375 399.8776041666667 399.95355902777777 400.0911458333333 400.09461805555554 400.1267361111111 400.1770833333333 400.5759548611111 400.84461805555554 400.89366319444446 401.0104166666667 401.1584201388889 401.48784722222223 401.62847222222223 401.66710069444446 401.87456597222223 402.26258680555554 402.57118055555554 402.8567708333333 405.19574652777777 405.6177455357143
Chat opening (CPU/JS) Baseline
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

Current
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Chat opening (CPU/UI) Baseline
Mean: 30.403 %
Stdev: 2.027 % (6.7%)
Runs: 25.4 25.5 26.2 26.4 26.8 27.1 27.5 28.1 28.2 28.6 28.8 28.9 29 29.1 29.2 29.3 29.4 29.4 29.6 29.6 29.6 29.8 29.8 30 30.2 30.6 30.9 30.9 30.9 31 31 31.1 31.1 31.2 31.3 31.3 31.3 31.6 31.6 31.6 31.7 31.9 31.9 32.1 32.1 32.2 32.2 32.2 32.2 32.3 32.3 32.5 32.6 32.7 32.8 32.9 33.5 34.4

Current
Mean: 30.361 %
Stdev: 1.950 % (6.4%)
Runs: 25.9 26.2 26.7 27.6 27.6 27.6 27.7 27.9 28 28.2 28.3 28.5 29 29.1 29.2 29.5 29.5 29.5 29.7 29.7 29.7 29.9 30.1 30.4 30.4 30.5 30.5 30.5 30.5 30.6 30.6 30.6 30.8 30.9 31 31.1 31.2 31.2 31.3 31.3 31.4 31.5 31.6 31.7 31.8 31.8 32.1 32.2 32.6 33.1 33.1 33.2 33.3 33.9 34.1 34.3
Money request - Open Manual Tracking Baseline
Mean: 230.626 ms
Stdev: 17.027 ms (7.4%)
Runs: 179.0815430060029 191.53279700130224 203.172159999609 209.0495200008154 209.74288000166416 210.51786299794912 212.50675500184298 212.72220899909735 213.52331499755383 213.7482089996338 213.92716500163078 216.29870600253344 218.0803630053997 219.58898900449276 220.28645800054073 220.77408900111914 221.41935300081968 221.46122300624847 222.63570100069046 223.08394400030375 226.16292300075293 227.1360680013895 227.66048200428486 228.91154000163078 229.15275099873543 230.62654700130224 230.9274499937892 231.13395100086927 233.0956619977951 235.34822600334883 236.0485030040145 237.87638400495052 238.52587900310755 238.74141500145197 238.94051099568605 239.02819800376892 239.21415200084448 239.24564699828625 239.34643600136042 239.4040530025959 239.43550699949265 241.54943899810314 242.74727399647236 242.91528400033712 243.45483399927616 243.88183600455523 246.9864500015974 247.15531399846077 248.73685700446367 250.958740003407 253.67509000003338 254.77087400108576 254.88277200609446 261.49357099831104 272.08805299550295

Current
Mean: 230.901 ms
Stdev: 13.411 ms (5.8%)
Runs: 189.96191400289536 205.497356005013 212.24694899469614 214.52441400289536 216.7147630006075 218.76436299830675 218.9594729989767 219.410359993577 219.69421400129795 220.1525880023837 220.32145200669765 220.96879100054502 221.87137799710035 222.1295569986105 222.14505999535322 222.72265600413084 222.95719400048256 225.10563099384308 225.78544100373983 225.93062400072813 226.0306399986148 226.29960200190544 226.6697999984026 231.03161600232124 231.24519899487495 231.35921200364828 232.45462999492884 233.1332600042224 233.381511002779 233.39685099571943 233.66178400069475 234.16540499776602 235.785074993968 237.38968899846077 238.00024399906397 238.2469080016017 238.63289400190115 240.494669996202 240.53768000006676 240.54044599831104 240.6502280011773 243.93819200247526 244.2598880007863 244.5710450038314 245.30318200588226 251.93741899728775 253.72314500063658 256.2453210055828 256.6773690059781 259.42358399927616
Money request - Open Contacts Baseline
Mean: 634.705 ms
Stdev: 147.359 ms (23.2%)
Runs: 315.87552899867296 337.21252500265837 427.09208200126886 436.70015500485897 437.71602400392294 438.99772199988365 453.500041000545 462.17565900087357 465.95776399970055 477.3063560053706 481.16617800295353 489.26997900009155 492.1761890053749 492.29663100093603 501.36519299447536 502.1470539942384 504.62687200307846 505.7159430012107 506.385945007205 519.6531990021467 533.7113859951496 534.828083999455 542.7284750044346 557.7075200006366 570.0926520004869 592.3824060037732 596.8715410009027 625.1025390028954 659.5027669966221 662.5107830017805 666.2802740037441 674.3996580019593 684.0977790057659 694.3170170038939 702.0888670012355 720.2602950036526 725.6228440031409 728.5517989993095 732.084066003561 737.1901860013604 738.2146819978952 739.0233150050044 742.1114099994302 742.7124439999461 755.8728440031409 757.5444749966264 760.4465740025043 776.2772630006075 778.4406739994884 779.0686039999127 779.6768800020218 799.5915530025959 808.968506000936 823.6075439974666 827.7704270035028 830.97489400208 836.5620530024171 864.902425006032 873.3641359955072 879.5260020047426

Current
Mean: 634.473 ms
Stdev: 154.311 ms (24.3%)
Runs: 336.1151529997587 336.2890219986439 343.0977370068431 376.57271299511194 387.71838399767876 425.3207600042224 439.0184319987893 443.4553219974041 447.30847200006247 447.812784999609 453.5943600013852 474.0870769992471 480.76273699849844 484.31050599366426 504.78544100373983 521.6041669994593 528.1337070018053 530.7371420040727 533.5186769962311 536.3291840031743 538.9162190034986 540.6515710055828 543.3073730021715 564.8676760047674 609.2558190003037 636.0521240010858 642.3825279995799 661.7139900028706 673.8584399968386 680.8144540041685 689.6234539970756 690.1499430015683 691.6907560005784 694.0552980005741 697.0517170056701 701.3479010015726 703.0068359971046 703.282104998827 706.0925699993968 725.6445719972253 730.8948570042849 739.8262939974666 743.9300540015101 748.2860929965973 767.5682379975915 767.6741949990392 768.191080994904 772.4831949993968 773.2307130023837 773.5733240023255 779.2406819984317 791.930785998702 795.1182860061526 799.5017090067267 803.2158199995756 822.035400994122 843.1223559975624 866.175699993968 883.4703779965639 974.572591997683
Money request - Open Create Baseline
Mean: 190.987 ms
Stdev: 3.030 ms (1.6%)
Runs: 183.32694500684738 183.5296219959855 183.75105799734592 183.90291300415993 184.42639099806547 188.27681500464678 188.47697000205517 188.7333580031991 189.27807600051165 189.44462099671364 189.50785300135612 189.53177899867296 189.54870600253344 189.7134189978242 189.7572019994259 190.08569299429655 190.2800699993968 190.2865389958024 190.3496099933982 190.4479580000043 190.47888199985027 190.50345899909735 190.84505200386047 191.01241099834442 191.10978200286627 191.22025600075722 191.42281099408865 191.4980880022049 191.56762799620628 191.57389400154352 191.63057500123978 191.7231860011816 191.79065000265837 192.00866699963808 192.04781100153923 192.32963000237942 192.54370099306107 192.91064500063658 193.23946199566126 193.25016299635172 193.30326300114393 193.5031330063939 193.6288250014186 193.8635260015726 193.94722500443459 194.11503099650145 194.3748780041933 194.7827150002122 194.8999029994011 195.51582899689674 195.83614100515842 196.21386700123549

Current
Mean: 190.187 ms
Stdev: 2.135 ms (1.1%)
Runs: 184.85925299674273 186.52783200144768 186.58422899991274 187.0023600012064 187.22709200531244 187.34737199544907 187.57291699945927 187.66320800036192 188.04809499531984 188.09118599444628 188.48457899689674 188.8589270040393 189.04089400172234 189.0542400032282 189.28409799933434 189.32100399583578 189.60400399565697 189.6346030011773 189.81241900473833 189.84399399906397 189.95910599827766 190.05033399909735 190.19079600274563 190.4239509999752 190.47985900193453 190.68420399725437 190.69454000145197 190.7710769996047 190.81449400633574 190.89322900027037 190.9457609951496 190.95967599749565 191.04252099990845 191.20393900573254 191.22338800132275 191.38631200045347 191.39518200606108 191.4354249984026 191.8879809975624 191.97749800235033 192.1000979989767 192.4681399986148 192.6758630052209 192.74186199903488 193.14615900069475 193.89827500283718 193.96748899668455 195.68269900232553
Money request (CPU) Baseline
Mean: 179.166 %
Stdev: 4.188 % (2.3%)
Runs: 171.72032265528716 172.35916926500747 172.43634132496027 172.68816474994355 172.7666575072576 173.190560921299 173.2062919245927 174.1189882359527 174.85837828259793 175.04164573765365 175.09235815954196 175.36958089401148 175.44474396051862 175.92964337394594 176.0132394981475 176.38945962988373 176.6981542669298 176.7659900544776 176.78755002497513 176.86298597501545 177.10039704317 177.11680893661625 177.17735280332744 177.29751951214362 177.32349593124675 178.18950255301996 178.37908705760165 178.40569773108075 178.48320726847174 178.64247651767243 178.6965493899446 178.9015554006527 179.24272845398846 179.58361596350952 179.75192862358233 179.84994989538814 180.09764784304764 180.1249850947476 180.752126748298 180.881882405083 180.94721342406962 181.06359034324083 181.11899121352235 182.10357604200422 182.1967449359538 182.66224985428377 182.93468334641278 183.27541317939296 183.48557911044082 183.66231890428628 183.97332589815687 184.06436075833565 184.37004704896674 184.4859477504629 184.9818360490124 185.02005823697436 185.88910155993892 186.66575822565093 188.17083387793738 189.1643341784045

Current
Mean: 179.733 %
Stdev: 4.378 % (2.4%)
Runs: 169.4647657278218 171.4700684253344 171.85652362782875 172.86544362974212 173.40189018680346 173.4807462626207 173.7850855090321 174.17741003520746 175.39419568442153 175.47873970831907 175.75846926620807 175.93663990680406 175.9657389707036 176.56159921093902 176.6173757486833 176.773408946526 177.04474202514933 177.20158505440548 177.36521761382295 177.58401906838233 177.81347882769637 177.94648421051107 177.94820879796245 178.55772313683457 178.71122066814726 178.87942359703825 179.28784899568674 179.48083046273052 179.58416711768785 179.76346010608128 179.80206307879158 180.21910389342165 180.24438454446707 180.26222261422276 180.3971627029249 180.7356862224794 181.10498493152681 181.21768978275006 181.4466760860542 181.55109858261946 181.74288099681115 181.81985380973654 182.232852212921 182.37088391700348 182.53728344407486 182.93493766490795 184.02763599327844 184.14562655881193 184.20141173960704 184.44963835009762 184.59615135465333 184.7217049537953 184.8332834893846 185.16698128174747 185.29039452539376 185.3515323093129 185.36428528551036 185.94776255023962 187.11504300713705 192.01232387851692
Money request (FPS) Baseline
Mean: 58.160 FPS
Stdev: 0.841 FPS (1.4%)
Runs: 56.0704266947521 56.5717144470194 56.824784315962475 56.91091785968123 57.13168871790766 57.132695004952815 57.14641477873456 57.22779057294505 57.26014935853369 57.29767201111122 57.42789980736255 57.446564645865294 57.48901237087853 57.49807932270956 57.572113720182756 57.592973429364115 57.62794148988605 57.69517307323503 57.7107251492484 57.74293928077791 57.75873059666659 57.77590243100873 57.79509369873788 57.826124960270235 57.88905362663961 57.979689133833695 58.0036490231261 58.004516359535934 58.054435798411916 58.06298014173997 58.099321913890954 58.128239808771156 58.20638339836661 58.24010958615075 58.43193943565329 58.46424654431631 58.48838264089412 58.53503080316446 58.55676295432851 58.61211980886987 58.636601316423594 58.72683134755142 58.74540852660182 58.83141351455384 58.86523785980809 58.88511898228706 58.93260070993954 58.989016336566195 59.22744138652009 59.25332739203394 59.286466548170615 59.32620709149123 59.38950848434786 59.392722452444154 59.42651892980288 59.665644999666654 59.67744139126717 59.72374097655908

Current
Mean: 57.999 FPS
Stdev: 0.683 FPS (1.2%)
Runs: 56.56308058372499 56.678849873647884 56.80566073166044 57.008251916240454 57.08291365558748 57.25934949435495 57.32642246068559 57.40012393401141 57.43891457010539 57.44047656142614 57.49874286682704 57.51357182625351 57.573021158540854 57.57827271151528 57.626686941390446 57.637083562425246 57.667694394524965 57.68960922790653 57.69126998562654 57.69456441318505 57.70532717876313 57.71986798330547 57.720731558438224 57.77398747787076 57.78177984025989 57.78494848580264 57.82311460465957 57.84811559781789 57.89736393850949 57.90153967016483 57.90488675165026 57.974153130981485 57.99211405338636 58.00013881910189 58.07228328021649 58.13170027048219 58.13572496017851 58.27700426565226 58.301590610998815 58.34413023606719 58.42661860042655 58.4565511003026 58.55964296027058 58.617877788948284 58.768051168558856 58.78621481508857 58.792425481128156 58.81015238473272 58.85951259331374 58.882012646296154 59.00374651889922 59.227691394449764 59.36510713870655 59.532429221524765 59.57735366205645
Money request (RAM) Baseline
Mean: 451.439 MB
Stdev: 7.825 MB (1.7%)
Runs: 433.91947115384613 434.74832589285717 439.64564732142856 440.1246995192308 441.9284855769231 442.2864583333333 442.32271634615387 443.4349888392857 444.8013392857143 445.21634615384613 445.25721153846155 445.5654296875 445.73130580357144 445.93359375 445.98647836538464 447.15865384615387 447.68419471153845 448.45340401785717 448.61778846153845 448.78236607142856 448.97181919642856 449.541015625 449.5847355769231 449.72205528846155 449.7581129807692 449.9095982142857 449.94711538461536 449.9575892857143 450.54213169642856 450.75502232142856 451.02163461538464 451.44861778846155 451.75864955357144 452.07481971153845 452.6478794642857 453.20913461538464 453.9269831730769 453.95102163461536 454.9790736607143 455.6180889423077 455.7825520833333 455.8407451923077 455.975390625 456.83286830357144 457.13588169642856 457.1721754807692 457.23497596153845 457.4846754807692 457.7605168269231 460.3551136363636 460.59765625 464.94487847222223 467.2199519230769 467.88671875 469.296484375 472.13755580357144

Current
Mean: 449.599 MB
Stdev: 6.958 MB (1.5%)
Runs: 432.4405048076923 434.7854817708333 436.1066706730769 438.53627232142856 439.5841619318182 441.59849330357144 442.14146205357144 442.62830528846155 442.72596153846155 443.44741586538464 444.2707331730769 444.6376201923077 444.9007161458333 445.29017857142856 445.353515625 445.61117788461536 445.74637276785717 446.3278245192308 446.69921875 446.94981971153845 447.50991586538464 447.51534598214283 447.7084263392857 447.71400669642856 448.3004807692308 448.65848214285717 448.93539663461536 449.3013392857143 449.503515625 449.59095982142856 449.783203125 450.48800223214283 450.49581473214283 450.83052884615387 451.37289663461536 451.8858173076923 451.8909254807692 452.3197544642857 452.3434495192308 452.428515625 452.8666294642857 452.86690848214283 453.4110576923077 453.70625 453.7887369791667 454.3627232142857 454.8306361607143 456.1610576923077 456.40546875 456.5963541666667 459.0767299107143 460.08383413461536 460.4326923076923 462.4227764423077 462.7136418269231 463.37349759615387 465.6763392857143
Money request (CPU/JS) Baseline
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

Current
Mean: 0.000 %
Stdev: 0.000 % (NaN%)
Runs: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Money request (CPU/UI) Baseline
Mean: 38.805 %
Stdev: 1.293 % (3.3%)
Runs: 36.1 36.1 36.9 37 37.2 37.2 37.4 37.6 37.6 37.6 37.6 37.7 37.8 37.9 37.9 38 38 38 38.1 38.2 38.3 38.3 38.3 38.3 38.3 38.5 38.5 38.5 38.6 38.6 38.6 38.7 38.8 38.9 39 39 39.1 39.1 39.1 39.3 39.4 39.4 39.4 39.5 39.6 39.7 39.7 39.8 40.1 40.2 40.4 40.4 40.4 40.6 40.7 41 41.7 41.8 42

Current
Mean: 39.073 %
Stdev: 1.847 % (4.7%)
Runs: 35.5 35.9 36.1 36.5 36.8 36.9 37.1 37.3 37.3 37.4 37.4 37.4 37.5 37.5 37.6 37.6 37.7 37.7 38.1 38.1 38.1 38.2 38.2 38.2 38.4 38.5 38.5 38.5 38.7 38.7 38.7 38.8 39 39 39 39.1 39.2 39.5 39.7 40 40 40.2 40.2 40.3 40.3 40.7 40.8 40.9 40.9 41 41 41.1 41.2 41.4 41.4 41.7 42.2 42.3 43.1 44.3

Copy link
Contributor

@Expensify/mobile-deployers 📣 Please look into this performance regression as it's a deploy blocker.

@francoisl
Copy link
Contributor Author

^ Sounds like a false positive, this PR just removes a beta and doesn't affect the search router.

Copy link
Contributor

🚀 Deployed to production by https://github.com/marcaaron in version: 9.1.28-15 🚀

platform result
🖥 desktop 🖥 success ✅
🕸 web 🕸 success ✅
🤖 android 🤖 failure ❌
🍎 iOS 🍎 success ✅

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CP Staging marks PRs that have been CP'd to staging
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants