Skip to content

fix: Update second Allow location access modal on web #51709

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 8 commits into from
Nov 19, 2024

Conversation

truph01
Copy link
Contributor

@truph01 truph01 commented Oct 30, 2024

Explanation of Change

Fixed Issues

$ #50601
PROPOSAL: #50601 (comment)

Tests

Prerequisite for all test cases:

Update code:

if (gpsRequired) {
const shouldStartLocationPermissionFlow =
!lastLocationPermissionPrompt ||
(DateUtils.isValidDateString(lastLocationPermissionPrompt ?? '') &&
DateUtils.getDifferenceInDaysFromNow(new Date(lastLocationPermissionPrompt ?? '')) > CONST.IOU.LOCATION_PERMISSION_PROMPT_THRESHOLD_DAYS);
if (shouldStartLocationPermissionFlow) {
setStartLocationPermissionFlow(true);
return;
}
}

        if (gpsRequired) {
            setStartLocationPermissionFlow(true);
            return;
        }

to remove the 7 days period.

Test 1: For [Chrome]

  1. Clear all the ND's permission in chrome://settings/content/location if has.
  2. FAB > Submit expense > Scan > Upload receipt.
  3. In confirmation page, click "Submit expense". Verify the below modal is displayed:

image

  1. Choose "Continue". Verify the below modal is displayed:

image

  1. Choose "Block".

  2. FAB > Submit expense > Scan > Upload receipt.

  3. In confirmation page, click "Submit expense". Verify the below modal is displayed:

image

  1. Choose "Got it". Verify the expense is submitted.

Test 2: For [Safari]

  1. Login in ND in new tab.
  2. FAB > Submit expense > Scan > Upload receipt.
  3. In confirmation page, click "Submit expense". Verify the below modal is displayed:

image

  1. Choose "Continue". Verify the below modal is displayed:

image

  1. Choose "Don't allow".

  2. FAB > Submit expense > Scan > Upload receipt.

  3. In confirmation page, click "Submit expense". Verify the below modal is displayed:

image

  1. Choose "Continue". Verify the expense is submitted.

Test 3: For Android/IOS app

  1. FAB > Submit expense > Scan > Upload receipt.
  2. In confirmation page, click "Submit expense". Verify the below modal is displayed:

image

  1. Choose "Continue". Verify the below modal is displayed:

image

  1. Choose "Don't Allow".

  2. FAB > Submit expense > Scan > Upload receipt.

  3. In confirmation page, click "Submit expense". Verify the below modal is displayed:

image

  1. Choose "Settings". Verify app redirect to setting screen.
  • Verify that no errors appear in the JS console

Offline tests

QA Steps

Test 1: For [Chrome]

  1. Clear all the ND's permission in chrome://settings/content/location if has.
  2. FAB > Submit expense > Scan > Upload receipt.
  3. In confirmation page, click "Submit expense". Verify the below modal is displayed:

image

  1. Choose "Continue". Verify the below modal is displayed:

image

  1. Choose "Block".

  2. 7 days later: FAB > Submit expense > Scan > Upload receipt.

  3. In confirmation page, click "Submit expense". Verify the below modal is displayed:

image

  1. Choose "Got it". Verify the expense is submitted.

Test 2: For [Safari]

  1. Login in ND in new tab.
  2. FAB > Submit expense > Scan > Upload receipt.
  3. In confirmation page, click "Submit expense". Verify the below modal is displayed:

image

  1. Choose "Continue". Verify the below modal is displayed:

image

  1. Choose "Don't allow".

  2. 7 days later: FAB > Submit expense > Scan > Upload receipt.

  3. In confirmation page, click "Submit expense". Verify the below modal is displayed:

image

  1. Choose "Continue". Verify the expense is submitted.

Test 3: For Android/IOS app (This PR does not change the Android/IOS logic, so just add the test steps to make sure it works as it is)

  1. FAB > Submit expense > Scan > Upload receipt.
  2. In confirmation page, click "Submit expense". Verify the below modal is displayed:

image

  1. Choose "Continue". Verify the below modal is displayed:

image

  1. Choose "Don't Allow".

  2. 7 days later: FAB > Submit expense > Scan > Upload receipt.

  3. In confirmation page, click "Submit expense". Verify the below modal is displayed:

image

  1. Choose "Settings". Verify app redirect to setting screen.
  • Verify that no errors appear in the JS console

PR Author Checklist

  • I linked the correct issue in the ### Fixed Issues section above
  • I wrote clear testing steps that cover the changes made in this PR
    • I added steps for local testing in the Tests section
    • I added steps for the expected offline behavior in the Offline steps section
    • I added steps for Staging and/or Production testing in the QA steps section
    • I added steps to cover failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
    • I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
    • I tested this PR with a High Traffic account against the staging or production API to ensure there are no regressions (e.g. long loading states that impact usability).
  • I included screenshots or videos for tests on all platforms
  • I ran the tests on all platforms & verified they passed on:
    • Android: Native
    • Android: mWeb Chrome
    • iOS: Native
    • iOS: mWeb Safari
    • MacOS: Chrome / Safari
    • MacOS: Desktop
  • I verified there are no console errors (if there's a console error not related to the PR, report it or open an issue for it to be fixed)
  • I followed proper code patterns (see Reviewing the code)
    • I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick)
    • I verified that the left part of a conditional rendering a React component is a boolean and NOT a string, e.g. myBool && <MyComponent />.
    • I verified that comments were added to code that is not self explanatory
    • I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
    • I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
      • If any non-english text was added/modified, I verified the translation was requested/reviewed in #expensify-open-source and it was approved by an internal Expensify engineer. Link to Slack message:
    • I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
    • I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
    • I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
    • I verified the JSDocs style guidelines (in STYLE.md) were followed
  • If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
  • I followed the guidelines as stated in the Review Guidelines
  • I tested other components that can be impacted by my changes (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar are working as expected)
  • I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
  • I verified any variables that can be defined as constants (ie. in CONST.js or at the top of the file that uses the constant) are defined as such
  • I verified that if a function's arguments changed that all usages have also been updated correctly
  • If any new file was added I verified that:
    • The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory
  • If a new CSS style is added I verified that:
    • A similar style doesn't already exist
    • The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG))
  • If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
  • If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
  • If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
  • If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
  • If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
    • I verified that all the inputs inside a form are aligned with each other.
    • I added Design label and/or tagged @Expensify/design so the design team can review the changes.
  • If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
  • If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.

Screenshots/Videos

Android: Native
output.mp4
Android: mWeb Chrome
Screen.Recording.2024-10-30.at.08.47.54.mov
iOS: Native
Screen.Recording.2024-10-30.at.08.41.50.mov
iOS: mWeb Safari
Screen.Recording.2024-10-30.at.09.14.04.mov
MacOS: Chrome / Safari
output.mp4
MacOS: Desktop
Screen.Recording.2024-10-30.at.09.11.28.mov

@truph01 truph01 marked this pull request as ready for review October 30, 2024 02:32
@truph01 truph01 requested a review from a team as a code owner October 30, 2024 02:32
@melvin-bot melvin-bot bot requested review from alitoshmatov and removed request for a team October 30, 2024 02:32
Copy link

melvin-bot bot commented Oct 30, 2024

@alitoshmatov Please copy/paste the Reviewer Checklist from here into a new comment on this PR and complete it. If you have the K2 extension, you can simply click: [this button]

@alitoshmatov
Copy link
Contributor

@truph01 After not allowing location access the modal is not appearing in second submit. Maybe it is because I am in newer version of chrome where it offer different options for choosing allowing access

Screen.Recording.2024-11-03.at.9.37.05.PM.mov

@truph01
Copy link
Contributor Author

truph01 commented Nov 5, 2024

@alitoshmatov Ah, I see it. Do you think it's actually related to our PR, given that we're focusing on updating the modal (title, subtitle, buttons) rather than modifying the logic for when it should be displayed?

@alitoshmatov
Copy link
Contributor

@alitoshmatov Ah, I see it. Do you think it's actually related to our PR, given that we're focusing on updating the modal (title, subtitle, buttons) rather than modifying the logic for when it should be displayed?

I guess not, but would be great if we considered this possibility as well.

@alitoshmatov
Copy link
Contributor

@truph01 I am also noticing that in your ios safari recording, the modal is shown second time you submit a scan but clicking continue does not show native location permission modal. In my simulator after I reject location first time, no modal is shown in second scan request

permission-safari.mp4

@alitoshmatov
Copy link
Contributor

In ios also the modal is shown only in first scan request. After rejecting native permission modal first time submitting second invoice request is not triggering modal

permission-ios.mp4

@alitoshmatov
Copy link
Contributor

That is three places – Ios native, Ios safari, Mac chrome which shows only first modal not the second modal with "Got it" button or "Settings" button.

If this is accepted behavior we should reconsider testing steps to prevent further confusion

@truph01
Copy link
Contributor Author

truph01 commented Nov 7, 2024

@alitoshmatov We are encountering different behavior in Chrome, maybe because of the Chrome version (Here is from @alitoshmatov and the one in the screen recording section is from my side). So, I wonder how I can write the test steps properly in Chrome?

cc @Julesssss

@Julesssss
Copy link
Contributor

Julesssss commented Nov 7, 2024

@alitoshmatov Ah, I see it. Do you think it's actually related to our PR, given that we're focusing on updating the modal (title, subtitle, buttons) rather than modifying the logic for when it should be displayed?

In ios also the modal is shown only in first scan request. After rejecting native permission modal first time submitting second invoice request is not triggering modal

I think that sounds like our logic that only prompts the user for location once every 7 days? (each client tracks this seprerately)

I agree we need to have well defined test steps. After retesting with the 7 day throttle disabled lets see if our experiences match. To help with this I branched from these changes HERE with that logic removed, and test builds are currently being built...

  1. Choose "Don't Allow".

Also, this screenshot is incorrect for mobile, can you change it to the native permission modal so that QA aren't confused.

@truph01
Copy link
Contributor Author

truph01 commented Nov 8, 2024

retesting with the 7 day throttle disabled

@alitoshmatov The behaviors in here, here and here are tested when disabling the 7 day throttle, no? If no, could you help try again?

@alitoshmatov
Copy link
Contributor

alitoshmatov commented Nov 10, 2024

Same result is happening, I think branched test PR does not have correct changes

-            const shouldStartLocationPermissionFlow =
-                !lastLocationPermissionPrompt ||
-                (DateUtils.isValidDateString(lastLocationPermissionPrompt ?? '') &&
-                    DateUtils.getDifferenceInDaysFromNow(new Date(lastLocationPermissionPrompt ?? '')) > CONST.IOU.LOCATION_PERMISSION_PROMPT_THRESHOLD_DAYS);
+            const shouldStartLocationPermissionFlow = !lastLocationPermissionPrompt;

The condition is not what we expect here. shouldStartLocationPermissionFlow is false in the second try because after first time lastLocationPermissionPrompt stores the timestamp of that.

@alitoshmatov
Copy link
Contributor

I think shouldStartLocationPermissionFlow should be always true to ignore 7 day throttle.

Also, @truph01 if there were 7 day throttle how were you able to test your PR and produce expected results(two permission modals sequentially) since it is clear that chrome version was not playing any role here.

@truph01
Copy link
Contributor Author

truph01 commented Nov 11, 2024

Also, @truph01 if there were 7 day throttle how were you able to test your PR and produce expected results

I forgot to mention that I also temporarily removed the 7-day throttle as a hard-coded adjustment for testing purposes.

@truph01
Copy link
Contributor Author

truph01 commented Nov 12, 2024

@alitoshmatov Could you give me the Chrome version from your side?

I updated the version but cannot reproduce like this one:

image

@alitoshmatov
Copy link
Contributor

alitoshmatov commented Nov 12, 2024

Now after setting shouldStartLocationPermissionFlow to always true everything works as expected. Well kinda, I don't know if followings are expected

  1. In android in second attempt modal is showing Continue button after it is pressed then it is switching to Settings(see video 👇 )
  2. In ios safari, second attemp modal is showing Continue button and pressing it does nothing and submits the scan
    Edit: I see yours also does the same based screen recordings in OP, is this expected behavior?
location-android.mov
location-ios.mp4

@alitoshmatov
Copy link
Contributor

@alitoshmatov Could you give me the Chrome version from your side?

@truph01 As I said here, branched PR by @Julesssss had wrong conditions to ignore 7 day period that is why I got the same result. Now after correctly removing 7 day throttle issue is solved in web chrome.

@Julesssss
Copy link
Contributor

Julesssss commented Nov 12, 2024

Just a note, iOS only lets us prompt once for location permission if users says NO. But Android lets us prompt twice. So there is a slight difference.

Android

In android in second attempt modal is showing Continue button after it is pressed then it is switching to Settings(see video 👇 )

This is almost correct I think:

1st attempt - 'Dont' allow'

  • Expense submitted

2nd attempt - 'Dont' allow'

  • Expense wasn't submitted -- ❌ it should have submitted without location, that is the only bug
  • Button changes to settings -- ✅ user shouldn't see this until the 3rd attempt, but it is technically correct. After the second 'Not now' response to the native prompt, the button will change because users now have to manually enable in settings

iOS

In ios safari, second attempt modal is showing Continue button and pressing it does nothing and submits the scan

I think this is expected. But that's not what I see in your video -- I see the native app:

Screenshot 2024-11-12 at 10 53 04

@alitoshmatov
Copy link
Contributor

@Julesssss Sorry uploaded wrong file, here is ios safari version

location-safari.MP4

@Julesssss
Copy link
Contributor

Thanks @alitoshmatov

In ios safari, second attemp modal is showing Continue button and pressing it does nothing and submits the scan

Cool so this seems like the last thing to fix. We should be showing the updated text here for web

@truph01 the test steps (and desired behaviour) is that we show this different text for web on the second attempt, do you think maybe a recent change broken that? Once that's showing again I think we are done here

381365242-8d43f39b-51b7-4bbe-857e-0c5e3aea0590

@@ -81,15 +81,22 @@ function LocationPermissionModal({startPermissionFlow, resetPermissionFlow, onDe
setShowModal(false);
resetPermissionFlow();
};

const locationErrorMessage = useMemo(() => (isWeb ? 'receipt.allowLocationFromSetting' : 'receipt.locationErrorMessage'), [isWeb]);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We don't seem to show this message on web with the current changes

@truph01
Copy link
Contributor Author

truph01 commented Nov 13, 2024

@alitoshmatov The behavior in safari (both MacOS and IOS) is:

  1. Login in the incognito tab.
  2. FAB > Submit expense > Scan > Upload receipt.
  3. In confirmation page, click "Submit expense". Verify the below modal is displayed (It is a pre-check current permission step and the permission returned is "Denied"):

image

  1. Choose "Continue". Verify the below modal is displayed (It is a prompt step):

image

  1. Choose "Don't allow". (The permission returned is "Blocked")

  2. FAB > Submit expense > Scan > Upload receipt.

  3. On confirmation page, click "Submit expense". Verify the below modal is displayed (It is a pre-check current permission step and the permission returned is "Denied"):

image

  1. Choose "Continue". (Now the permission returned is "Blocked"). Expense is submitted.

In Chrome, we check whether the pre-check for the current permission status returns "Blocked." This allows us to determine if the previous prompt was rejected. If it was, we display the second "Allow location access" modal.

In Safari, however, the pre-check for the current permission status always returns "Denied," which makes it impossible to determine if the previous prompt was rejected. Consequently, it becomes difficult to decide when to display the second "Allow location access" modal. As a result, Safari always shows the first modal. This discrepancy leads to the observed behavior.

In ios safari, second attemp modal is showing Continue button and pressing it does nothing and submits the scan

@alitoshmatov
Copy link
Contributor

In Safari, however, the pre-check for the current permission status always returns "Denied,"

I see. I think everything looks good, @truph01 please update QA steps for each case in OP. I will complete the checklist

@truph01
Copy link
Contributor Author

truph01 commented Nov 18, 2024

@alitoshmatov I updated test cases for Chrome and Safari.

@alitoshmatov
Copy link
Contributor

Reviewer Checklist

  • I have verified the author checklist is complete (all boxes are checked off).
  • I verified the correct issue is linked in the ### Fixed Issues section above
  • I verified testing steps are clear and they cover the changes made in this PR
    • I verified the steps for local testing are in the Tests section
    • I verified the steps for Staging and/or Production testing are in the QA steps section
    • I verified the steps cover any possible failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
    • I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
  • I checked that screenshots or videos are included for tests on all platforms
  • I included screenshots or videos for tests on all platforms
  • I verified tests pass on all platforms & I tested again on:
    • Android: Native
    • Android: mWeb Chrome
    • iOS: Native
    • iOS: mWeb Safari
    • MacOS: Chrome / Safari
    • MacOS: Desktop
  • If there are any errors in the console that are unrelated to this PR, I either fixed them (preferred) or linked to where I reported them in Slack
  • I verified proper code patterns were followed (see Reviewing the code)
    • I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick).
    • I verified that the left part of a conditional rendering a React component is a boolean and NOT a string, e.g. myBool && <MyComponent />.
    • I verified that comments were added to code that is not self explanatory
    • I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
    • I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
    • I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
    • I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
    • I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
    • I verified the JSDocs style guidelines (in STYLE.md) were followed
  • If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
  • I verified that this PR follows the guidelines as stated in the Review Guidelines
  • I verified other components that can be impacted by these changes have been tested, and I retested again (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar have been tested & I retested again)
  • I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
  • I verified any variables that can be defined as constants (ie. in CONST.js or at the top of the file that uses the constant) are defined as such
  • If a new component is created I verified that:
    • A similar component doesn't exist in the codebase
    • All props are defined accurately and each prop has a /** comment above it */
    • The file is named correctly
    • The component has a clear name that is non-ambiguous and the purpose of the component can be inferred from the name alone
    • The only data being stored in the state is data necessary for rendering and nothing else
    • For Class Components, any internal methods passed to components event handlers are bound to this properly so there are no scoping issues (i.e. for onClick={this.submit} the method this.submit should be bound to this in the constructor)
    • Any internal methods bound to this are necessary to be bound (i.e. avoid this.submit = this.submit.bind(this); if this.submit is never passed to a component event handler like onClick)
    • All JSX used for rendering exists in the render method
    • The component has the minimum amount of code necessary for its purpose, and it is broken down into smaller components in order to separate concerns and functions
  • If any new file was added I verified that:
    • The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory
  • If a new CSS style is added I verified that:
    • A similar style doesn't already exist
    • The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG)
  • If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
  • If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
  • If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
  • If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
  • If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
    • I verified that all the inputs inside a form are aligned with each other.
    • I added Design label and/or tagged @Expensify/design so the design team can review the changes.
  • If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
  • If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.
  • I have checked off every checkbox in the PR reviewer checklist, including those that don't apply to this PR.

Screenshots/Videos

Android: Native
location-android.mov
Android: mWeb Chrome
location-mweb.mov
iOS: Native
location-ios.mp4
iOS: mWeb Safari
location-safari.MP4
MacOS: Chrome / Safari
location-web.mov
MacOS: Desktop
location-desktop.mov

Copy link
Contributor

@alitoshmatov alitoshmatov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

Copy link
Contributor

🚧 @Julesssss has triggered a test build. You can view the workflow run here.

Copy link
Contributor

Copy link
Contributor

@Julesssss Julesssss left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the detailed tests. It's working well for me.

I wasn't able to enable camera permission on Android mWeb but this already exists in production.

@Julesssss Julesssss merged commit f8819c5 into Expensify:main Nov 19, 2024
20 checks passed
@OSBotify
Copy link
Contributor

✋ This PR was not deployed to staging yet because QA is ongoing. It will be automatically deployed to staging after the next production release.

@github-actions github-actions bot added the DeployBlockerCash This issue or pull request should block deployment label Nov 19, 2024
Copy link
Contributor

Performance Comparison Report 📊

Significant Changes To Duration

Name Duration
Linking 905.935 ms → 1080.483 ms (+174.548 ms, +19.3%) 🔴
Show details
Name Duration
Linking Baseline
Mean: 905.935 ms
Stdev: 247.045 ms (27.3%)
Runs: 610.2313640005887 614.2238779999316 635.589883999899 666.4584149997681 669.3035480007529 673.409953000024 675.7799079995602 686.9472660012543 689.3013919983059 692.5503749996424 692.8458669986576 693.9983319994062 694.3275969997048 694.5834149997681 694.7360839992762 696.716105999425 696.9933269992471 697.4814450014383 698.8541669994593 702.8652350008488 704.5596110001206 705.9196380004287 706.1656900011003 706.7625739984214 707.3679200001061 709.6400559991598 709.9655360002071 710.3811440002173 711.4757899995893 715.6281739994884 717.0274659991264 717.0891929995269 718.613445000723 719.3052169997245 719.3517260011286 720.8106689993292 720.8213710002601 720.9735109992325 721.0425620004535 721.137328999117 722.621703999117 723.5194090008736 725.2491459995508 726.6385089997202 728.8236899990588 729.3002109993249 730.9277350008488 731.4684250000864 735.2554930001497 736.5964770000428 741.6311440002173 741.6569420006126 742.3822029996663 743.6398120000958 750.7677419986576 753.5896000005305 758.0266929995269 758.3858240004629 768.8605150002986 911.6511640008539 1103.7086590006948 1108.7250580005348 1121.4953219983727 1130.6188149992377 1131.8410650007427 1142.1120209991932 1145.08158400096 1145.1641849987209 1149.1907560005784 1160.7321369983256 1174.3152679987252 1176.5288900006562 1181.7997239995748 1185.6007090006024 1191.4212239999324 1194.1955159995705 1194.2371429987252 1194.48775199987 1197.3576660007238 1198.9474689997733 1201.8385019991547 1203.7519530002028 1209.375976998359 1210.79349800013 1212.4279390014708 1217.5354820005596 1227.4265550002456 1230.9461679998785 1248.0555420015007 1259.3702000007033 1270.0482180006802 1285.0984300002456 1286.3889579996467 1300.3137209992856 1302.1400150004774 1316.7837319988757 1363.6516529992223 1385.9099540002644

Current
Mean: 1080.483 ms
Stdev: 251.435 ms (23.3%)
Runs: 755.5699870008975 808.9847419988364 818.1333409994841 822.8897300008684 824.1654469985515 826.7103679999709 830.6714279986918 837.5416269991547 840.5162760000676 842.4868170004338 846.5493990015239 846.8833419997245 849.7176520004869 850.5720220003277 851.2178140003234 852.1499429997057 854.1287849992514 859.1590989995748 871.0729979984462 873.0443120002747 875.36352599971 875.720093999058 876.035116000101 876.7216800004244 876.7416990008205 876.9101569987833 880.2917490005493 882.0057789999992 882.1609290000051 883.3198649995029 886.2490240000188 886.372640999034 886.6496580000967 888.6118169985712 889.1389160007238 889.6052660010755 889.722779000178 890.7331550009549 890.8540859986097 891.0268559996039 891.3242189995944 892.4926359988749 894.1463219989091 894.3840739987791 895.3860279992223 898.4871020000428 898.9011639989913 900.8857839982957 901.7137460000813 903.0255130007863 904.4665940012783 907.4432779997587 911.4315600004047 911.6347249988467 915.1957200001925 917.246703999117 920.1320399995893 922.6676029991359 924.5291750002652 973.3709309995174 1251.406617000699 1252.3402519989759 1256.1546229999512 1270.8573819994926 1272.6593430005014 1275.785076001659 1276.742920000106 1282.715331999585 1288.1240649987012 1288.2908530011773 1299.710815999657 1313.1833910010755 1324.375367000699 1330.5962739996612 1333.4952000007033 1333.9208990000188 1337.5529800001532 1340.9927979987115 1341.4116629995406 1343.0411379989237 1344.7720950003713 1345.313436999917 1350.0012619998306 1352.3376880008727 1354.6938889995217 1367.4088959991932 1368.176230000332 1379.3069259990007 1386.2695319987833 1392.706869000569 1403.4065769985318 1413.3739839997143 1444.1557219997048 1483.1857510004193 1487.6020919997245 1492.4565030001104 1494.8673100005835 1518.8149420004338 1521.488404000178 1549.957112999633 1555.5732429996133 1574.8020840007812

Meaningless Changes To Duration

Show entries
Name Duration
App start time nativeLaunchEnd_To_appCreationStart 78.186 ms → 61.237 ms (-16.949 ms, -21.7%) 🟢
App start time nativeLaunch 24.224 ms → 31.500 ms (+7.276 ms, +30.0%) 🟡
App start time TTI 1360.569 ms → 1300.849 ms (-59.721 ms, -4.4%)
App start time runJsBundle 430.034 ms → 405.567 ms (-24.467 ms, -5.7%)
App start time appCreationEnd_To_contentAppeared 609.603 ms → 563.621 ms (-45.983 ms, -7.5%)
App start time appCreation 81.650 ms → 80.136 ms (-1.514 ms, -1.9%)
App start time contentAppeared_To_screenTTI 556.929 ms → 562.281 ms (+5.352 ms, +1.0%)
App start time regularAppStart 0.021 ms → 0.021 ms (-0.000 ms, ±0.0%)
App start time (CPU) 137.042 % → 139.186 % (+2.144 %, +1.6%)
App start time (FPS) 60.000 FPS → 60.000 FPS
App start time (RAM) 355.718 MB → 353.872 MB (-1.846 MB, -0.5%)
App start time (CPU/JS) 75.235 % → 79.617 % (+4.382 %, +5.8%)
App start time (CPU/UI) 25.587 % → 26.660 % (+1.073 %, +4.2%)
Open search router TTI Load Search Options 107.063 ms → 108.681 ms (+1.618 ms, +1.5%)
Open search router TTI Open Search Router TTI 531.238 ms → 518.425 ms (-12.813 ms, -2.4%)
Open search router TTI (CPU) 137.131 % → 135.415 % (-1.716 %, -1.3%)
Open search router TTI (FPS) 60.000 FPS → 60.000 FPS
Open search router TTI (RAM) 364.304 MB → 365.687 MB (+1.383 MB, ±0.0%)
Open search router TTI (CPU/JS) 70.886 % → 69.365 % (-1.521 %, -2.1%)
Open search router TTI (CPU/UI) 27.258 % → 26.613 % (-0.645 %, -2.4%)
Report typing Composer typing rerender count 1.000 renders → 1.000 renders
Report typing Message sent 390.461 ms → 387.255 ms (-3.206 ms, -0.8%)
Report typing (CPU) 96.033 % → 95.648 % (-0.384 %, ±0.0%)
Report typing (FPS) 60.000 FPS → 60.000 FPS
Report typing (RAM) 501.722 MB → 502.258 MB (+0.536 MB, ±0.0%)
Report typing (CPU/JS) 44.215 % → 44.307 % (+0.091 %, ±0.0%)
Report typing (CPU/UI) 23.878 % → 23.905 % (+0.027 %, ±0.0%)
Chat opening Chat TTI 473.612 ms → 475.277 ms (+1.665 ms, ±0.0%)
Chat opening (CPU) 141.528 % → 141.536 % (+0.009 %, ±0.0%)
Chat opening (FPS) 60.000 FPS → 60.000 FPS
Chat opening (RAM) 371.862 MB → 376.791 MB (+4.929 MB, +1.3%)
Chat opening (CPU/JS) 70.827 % → 70.062 % (-0.765 %, -1.1%)
Chat opening (CPU/UI) 28.292 % → 28.409 % (+0.117 %, ±0.0%)
Linking (CPU) 149.157 % → 147.272 % (-1.885 %, -1.3%)
Linking (FPS) 60.000 FPS → 60.000 FPS
Linking (RAM) 411.608 MB → 424.380 MB (+12.772 MB, +3.1%)
Linking (CPU/JS) 80.110 % → 80.902 % (+0.792 %, +1.0%)
Linking (CPU/UI) 28.352 % → 27.405 % (-0.946 %, -3.3%)
Show details
Name Duration
App start time nativeLaunchEnd_To_appCreationStart Baseline
Mean: 78.186 ms
Stdev: 9.799 ms (12.5%)
Runs: 63 63 65 65 66 67 68 68 69 69 69 69 69 69 70 71 71 71 71 72 73 73 73 74 74 74 75 76 76 76 77 77 77 78 80 80 81 81 81 82 82 83 84 84 85 85 85 86 86 91 91 92 92 93 94 95 99 101 102

Current
Mean: 61.237 ms
Stdev: 9.684 ms (15.8%)
Runs: 44 46 47 49 50 51 51 52 52 52 52 52 53 53 53 54 55 55 55 56 56 57 57 57 57 57 58 58 58 59 59 59 60 60 63 63 63 63 64 65 67 67 67 68 68 68 68 68 71 71 73 74 75 78 78 78 81 82 86
App start time nativeLaunch Baseline
Mean: 24.224 ms
Stdev: 2.871 ms (11.9%)
Runs: 20 21 21 21 21 21 21 21 21 22 22 22 22 22 22 22 22 22 22 22 22 22 23 23 23 23 23 24 24 24 24 24 24 24 24 24 25 25 25 25 25 25 25 26 26 26 27 27 28 28 28 28 29 29 30 30 31 32

Current
Mean: 31.500 ms
Stdev: 3.797 ms (12.1%)
Runs: 27 27 27 27 27 27 28 28 28 28 28 28 28 28 29 29 29 29 29 29 29 29 29 29 30 30 30 30 30 30 30 30 31 31 31 31 31 32 32 32 32 33 33 34 34 34 34 35 36 36 36 37 37 37 37 37 39 40 41 41
App start time TTI Baseline
Mean: 1360.569 ms
Stdev: 78.556 ms (5.8%)
Runs: 1197.4734000004828 1210.1706639993936 1220.0540539994836 1247.7940309997648 1248.0481770001352 1252.3165770005435 1254.8872369993478 1260.8884709998965 1264.3605610001832 1266.619619999081 1268.6976059991866 1270.3258040007204 1281.204114999622 1288.1972180008888 1289.873438000679 1309.566888999194 1313.7041389998049 1320.577834000811 1323.9676430001855 1325.049071000889 1332.8387240003794 1336.3418259993196 1340.7122610006481 1343.265473999083 1344.2962319999933 1345.5475319996476 1361.2648549992591 1364.7983940001577 1367.685822000727 1367.8270529992878 1367.98708399944 1371.0384369995445 1371.060079999268 1373.9202479999512 1376.0492780003697 1380.3997840005904 1381.812441000715 1390.9618929997087 1392.4579210001975 1397.0042279995978 1398.216243000701 1400.152994999662 1402.1635100003332 1403.8980950005352 1415.6136450003833 1421.1661339998245 1425.6117029991 1427.2389490008354 1428.6682580001652 1431.7259429991245 1438.847425000742 1441.3515280000865 1449.3116560000926 1450.7531199995428 1457.0322050005198 1471.0389499999583 1486.9300280008465 1507.5379119999707 1527.4209599997848 1528.4444099999964

Current
Mean: 1300.849 ms
Stdev: 68.075 ms (5.2%)
Runs: 1168.971113000065 1172.8261789996177 1187.2547660004348 1190.3834199998528 1192.7658830005676 1193.4449550006539 1194.2829940002412 1197.333607999608 1204.3275569994003 1206.091406000778 1217.4710409995168 1218.2614040002227 1228.8611200004816 1240.4870929997414 1248.6081879995763 1257.4796789996326 1265.9877080004662 1270.4805350005627 1281.3071279991418 1283.3620970007032 1284.9099300000817 1290.2858399990946 1290.554284999147 1290.8167599998415 1290.977073000744 1304.2633859999478 1305.1715590003878 1306.8328130003065 1308.5066350009292 1313.66772400029 1314.124076999724 1315.4155999999493 1317.2361440006644 1322.0784559994936 1322.5702170003206 1325.6480240002275 1328.9303280003369 1329.0729750003666 1329.0796099994332 1333.0337940007448 1334.373632999137 1336.7742630001158 1336.7826029993594 1337.3423089999706 1347.2416730001569 1355.0507069993764 1356.5429439991713 1356.7024370003492 1359.3473080005497 1360.1462890002877 1365.6646149996668 1368.4592300001532 1368.8860219996423 1369.5692420005798 1376.3355940002948 1377.7203170005232 1392.897254999727 1398.1876929998398 1438.1629779990762 1471.588013999164
App start time runJsBundle Baseline
Mean: 430.034 ms
Stdev: 25.510 ms (5.9%)
Runs: 363 378 380 383 383 385 386 388 408 408 408 411 411 412 412 413 416 418 421 425 426 428 430 430 431 432 433 433 434 435 436 436 436 437 437 439 440 442 444 447 447 448 448 449 449 449 451 451 452 452 453 454 454 457 464 465 466 468 480

Current
Mean: 405.567 ms
Stdev: 25.612 ms (6.3%)
Runs: 350 355 356 357 361 366 369 372 377 378 380 381 389 389 390 392 393 393 393 394 395 397 398 399 400 400 401 403 404 405 406 407 407 409 412 413 414 417 418 419 421 424 425 425 426 427 427 428 428 431 432 436 437 438 439 441 442 448 449 451
App start time appCreationEnd_To_contentAppeared Baseline
Mean: 609.603 ms
Stdev: 34.482 ms (5.7%)
Runs: 531 536 538 541 547 555 565 566 567 574 579 579 582 589 592 592 598 599 601 602 602 603 606 606 608 608 609 609 613 614 614 616 618 620 622 622 624 626 626 627 629 631 631 633 635 637 638 639 642 644 647 648 649 657 658 663 663 687

Current
Mean: 563.621 ms
Stdev: 37.930 ms (6.7%)
Runs: 488 489 494 497 497 498 514 517 519 522 532 536 537 538 540 542 543 546 547 547 550 555 556 557 558 562 563 565 569 570 570 571 572 573 574 574 575 577 579 580 580 582 586 587 589 593 595 596 600 602 604 604 605 623 632 636 637 646
App start time appCreation Baseline
Mean: 81.650 ms
Stdev: 11.758 ms (14.4%)
Runs: 59 62 63 64 64 65 65 65 66 68 68 68 68 69 74 74 74 74 76 76 76 77 78 78 80 80 80 81 82 82 83 84 84 86 86 86 86 87 87 88 88 88 89 90 90 90 91 91 91 92 93 93 94 95 97 98 99 101 107 109

Current
Mean: 80.136 ms
Stdev: 10.349 ms (12.9%)
Runs: 59 59 62 65 67 68 68 69 70 70 71 72 72 73 74 74 75 75 75 75 75 75 76 76 76 77 77 77 78 78 79 79 81 81 82 82 83 83 84 84 85 86 86 86 87 88 90 91 91 91 91 92 93 93 95 98 100 101 108
App start time contentAppeared_To_screenTTI Baseline
Mean: 556.929 ms
Stdev: 34.214 ms (6.1%)
Runs: 497.4734000004828 499.2041149996221 499.3605610001832 501.70413899980485 507.1972180008888 507.6196199990809 509.3258040007204 511.7940309997648 517.1706639993936 519.265473999083 522.0540539994836 524.049071000889 525.8387240003794 526.6976059991866 526.8872369993478 535.5668889991939 539.0384369995445 540.9676430001855 541.577834000811 544.3418259993196 544.873438000679 547.8884709998965 549.6858220007271 552.9870839994401 553.0481770001352 557.2162430007011 557.3165770005435 557.5475319996476 561.8270529992878 563.060079999268 565.3997840005904 567.0042279995978 569.4579210001975 570.2648549992591 570.7122610006481 575.1635100003332 575.8124410007149 577.2962319999933 578.0389499999583 578.9618929997087 581.0492780003697 583.8980950005352 584.3515280000865 585.7259429991245 585.7983940001577 585.9202479999512 589.6117029991001 589.6682580001652 590.6136450003833 596.152994999662 596.1661339998245 601.3116560000926 618.2389490008354 625.8474250007421 646.0322050005198

Current
Mean: 562.281 ms
Stdev: 29.678 ms (5.3%)
Runs: 501.9711130000651 505.977073000744 512.3275569994003 513.4796789996326 515.3834199998528 516.4870929997414 520.4449550006539 527.4710409995168 529.2547660004348 529.7658830005676 530.8611200004816 531.8261789996177 538.3336079996079 538.6081879995763 538.9877080004662 545.2614040002227 545.7742630001158 549.1715590003878 549.2858399990946 549.9099300000817 551.6480240002275 551.8328130003065 553.0914060007781 556.3071279991418 558.5702170003206 559.3423089999706 560.5692420005798 562.2361440006644 563.2633859999478 563.8167599998415 565.4805350005627 565.8860219996423 567.0337940007448 568.4592300001532 568.897254999727 571.0784559994936 573.5542849991471 573.9303280003369 575.7024370003492 583.5066350009292 584.7203170005232 587.1240769997239 587.7826029993594 588.1876929998398 590.3620970007032 594.0729750003666 595.373632999137 595.5429439991713 595.6646149996668 596.1462890002877 599.4155999999493 603.66772400029 605.1629779990762 605.2416730001569 608.0796099994332 614.3355940002948 614.3473080005497
App start time regularAppStart Baseline
Mean: 0.021 ms
Stdev: 0.002 ms (7.3%)
Runs: 0.01769999973475933 0.017862999811768532 0.01839200034737587 0.018718000501394272 0.01908400095999241 0.019123999401926994 0.019449999555945396 0.019450001418590546 0.019530998542904854 0.019530998542904854 0.019531000405550003 0.019693998619914055 0.019694000482559204 0.019816000014543533 0.019938999786973 0.020142000168561935 0.02018199861049652 0.02018200047314167 0.020182998850941658 0.020262999460101128 0.020263999700546265 0.020344998687505722 0.020385999232530594 0.020386001095175743 0.02042599953711033 0.02042599953711033 0.02046699821949005 0.020507998764514923 0.020547999069094658 0.020547999069094658 0.020671000704169273 0.02103699930012226 0.021118000149726868 0.021118000149726868 0.021199999377131462 0.021240999922156334 0.02127999998629093 0.02144400030374527 0.021606000140309334 0.021687999367713928 0.021727999672293663 0.021769000217318535 0.02197199873626232 0.022257000207901 0.02225799858570099 0.022298000752925873 0.02237900160253048 0.022501999512314796 0.02254200167953968 0.02262299880385399 0.022623999044299126 0.0235190000385046 0.02364099957048893 0.0236820001155138 0.02376299910247326 0.023885000497102737 0.024780001491308212

Current
Mean: 0.021 ms
Stdev: 0.002 ms (7.3%)
Runs: 0.01769999973475933 0.017903000116348267 0.01822900027036667 0.018350999802350998 0.01879899948835373 0.018838999792933464 0.018960999324917793 0.019001999869942665 0.019571999087929726 0.019652999937534332 0.019694000482559204 0.01977499946951866 0.01985599845647812 0.019857000559568405 0.01989699900150299 0.020059999078512192 0.020100999623537064 0.02018200047314167 0.020183000713586807 0.020222999155521393 0.020264001563191414 0.02034500055015087 0.0204670000821352 0.020549001172184944 0.020711001008749008 0.020711999386548996 0.02087399922311306 0.020914999768137932 0.020956000313162804 0.02103699930012226 0.02120000123977661 0.021240001544356346 0.021320998668670654 0.02132199890911579 0.02132200077176094 0.021361999213695526 0.021525001153349876 0.021687999367713928 0.021890999749302864 0.02197299897670746 0.021973000839352608 0.022095000371336937 0.022175999358296394 0.022216999903321266 0.02242100052535534 0.02250099927186966 0.02266399934887886 0.022990001365542412 0.02307100035250187 0.023315001279115677 0.023396998643875122 0.023600000888109207 0.023723000660538673 0.023723000660538673
App start time (CPU) Baseline
Mean: 137.042 %
Stdev: 8.948 % (6.5%)
Runs: 116.87144618076266 122.00330697053609 122.01744183738683 122.70517928286851 124.65109621394657 124.66816458252455 125.98704959001016 128.42514304574627 128.55902777777777 129.69391163278937 129.70211053299525 130.89834432977176 131.07025585425245 131.44237192333384 131.44914572206045 131.6811841504792 131.77751068376065 131.78486055776895 131.92023427694886 132.0946050428336 132.3136745465467 132.7689429362533 133.14392275924453 133.66651736250265 133.67990726910625 134.58770888969119 134.68928834631032 134.70368562459575 134.78486055776895 135.0324167225576 135.0921746696394 135.24763009219546 136.61977420186915 136.92724093605537 137.18316594930658 137.56550643732467 138.02129547471162 139.1297405189621 139.77299412915852 140.05866872020425 140.093076628841 140.3858948769129 140.82040821205032 141.33422741942445 142.52334535376283 142.96167439805615 144.59328355241715 145.05371031493056 145.4716662240143 147.02999489991078 147.1824799196787 148.82050383072314 149.30493049304937 150.41584158415844 151.95628161153425 152.8539308114079 153.7490039840638 153.79736768857614 154.17449071371087 155.61397819574427

Current
Mean: 139.186 %
Stdev: 9.914 % (7.1%)
Runs: 113.67901646905389 122.32165314720496 125.68986083499007 126.20200518262413 126.46534653465343 127.4627072484592 128.01492329979558 128.30121543341454 128.34306431867404 128.54013642694733 128.88622754491016 129.0515225671412 129.41286517581918 129.97750364005825 130.05317282728186 132 132.88195326390652 132.93120104751338 133 133.08477237048663 133.10591377335223 133.7325349301398 133.8688085676038 134.0864263941187 134.47265506762074 134.73319963823678 135.38051713182463 136.9332290078165 136.9813249019937 138.46858965964697 138.56164521117435 138.91805051854678 140.8954279386173 141.01102999776853 142.1663714823874 143.0923499792481 143.50704225352118 144.7339122689824 145.63618290258452 145.70858283433142 146.040284501823 146.6093220237692 146.7768924302789 146.77790060521235 147.0554313848699 147.6234130621996 147.78662693179604 148.186118036301 148.70259481037928 149.10567514677103 149.81561035700645 150.0744011904191 151.04515984797678 151.33477633477636 151.92141453831042 153.26124690325537 154.4287171184471 156.870259481038 157.43936381709742 158.0120391627812
App start time (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
App start time (RAM) Baseline
Mean: 355.718 MB
Stdev: 9.267 MB (2.6%)
Runs: 340.599609375 342.71484375 343.552734375 343.58203125 344.140625 344.224609375 345.763671875 345.98828125 346.166015625 346.576171875 346.61328125 346.69921875 346.859375 347.96875 347.9921875 348.29296875 348.453125 348.998046875 349.2265625 349.873046875 349.89453125 350.06640625 350.255859375 350.7109375 350.87890625 352.04296875 353.763671875 354.09375 354.3515625 355.255859375 355.578125 355.59375 355.78515625 356.013671875 356.3255208333333 357.3359375 357.9388020833333 358.30859375 358.6276041666667 358.6315104166667 359.4322916666667 360.0208333333333 360.103515625 360.3385416666667 360.7265625 360.8580729166667 361.4283854166667 361.62109375 362.1783854166667 363.00390625 365.07421875 366.4388020833333 368.591796875 369.416015625 371.779296875 372.189453125 373.39453125 375.802734375 377.181640625 377.7890625

Current
Mean: 353.872 MB
Stdev: 10.017 MB (2.8%)
Runs: 339.71875 339.796875 340.701171875 341.263671875 341.267578125 341.427734375 341.55078125 341.83984375 342.505859375 342.798828125 342.9453125 343.65625 344.162109375 344.96875 345.384765625 345.41796875 345.546875 345.806640625 346.30859375 346.388671875 346.482421875 346.65234375 347.451171875 347.5078125 349.044921875 349.69140625 349.8046875 351.62109375 352.138671875 352.6966145833333 353.58203125 353.640625 354.51171875 354.541015625 354.857421875 355.5143229166667 355.74609375 357.072265625 357.21484375 357.8828125 360.27734375 360.3203125 360.6471354166667 361.353515625 361.67578125 361.791015625 362.830078125 363.013671875 364.5390625 364.69921875 367.37890625 367.7734375 368.69921875 368.91015625 369.69921875 370.15234375 370.84375 371.5 372.044921875 373.072265625
App start time (CPU/JS) Baseline
Mean: 75.235 %
Stdev: 6.590 % (8.8%)
Runs: 62.8 63.2 64 64.1 64.5 65.2 65.3 65.8 65.9 66 66.3 66.6 66.6 66.7 67 67.8 68.8 70.7 72.2 74.8 74.8 75.8 75.9 75.9 76.8 76.9 77.3 77.4 77.6 77.8 77.9 77.9 78 78 78 78.2 78.6 78.6 78.9 78.9 79.2 79.7 79.9 80 80 80.2 80.5 80.6 80.7 80.8 81.4 81.8 81.8 81.9 81.9 81.9 82.8 83.3 85.8 86.4

Current
Mean: 79.617 %
Stdev: 2.671 % (3.4%)
Runs: 72.8 73.7 74.8 75 75.9 75.9 76.7 76.8 77 77.8 77.8 77.9 77.9 78 78 78.4 78.5 78.9 78.9 78.9 79 79.3 79.6 79.7 79.8 79.9 79.9 79.9 80 80.1 80.3 80.5 80.8 80.8 80.8 80.9 80.9 81 81 81.2 81.3 81.4 81.4 81.6 81.8 82.2 82.7 83.8 84.7 84.7 84.7 84.8
App start time (CPU/UI) Baseline
Mean: 25.587 %
Stdev: 4.174 % (16.3%)
Runs: 16 18 18 18 18 18.9 19 19.8 20 20.9 21 21.9 22 22.1 22.7 22.9 22.9 23 23 23.8 23.9 24 24.3 25 25.1 25.9 25.9 26 26 26.1 26.6 27.3 27.4 27.5 27.5 27.7 27.7 27.8 27.8 27.8 27.8 28.1 28.2 28.5 28.6 28.6 28.7 29 29 29.1 29.8 29.9 30.1 30.1 30.7 30.9 31.2 31.7 31.9 34.1

Current
Mean: 26.660 %
Stdev: 3.656 % (13.7%)
Runs: 16 19 20.6 21 21.3 21.9 22 22 22.1 22.9 22.9 23 23 23.9 23.9 24 24.2 24.4 24.6 24.7 24.9 26 26 26.1 26.1 26.1 26.3 27 27 27 27.1 27.1 27.3 27.5 28 28 28 28 28.5 28.9 29.1 29.1 29.2 29.7 29.9 29.9 29.9 30.1 30.1 30.1 30.3 30.8 30.9 31.1 31.2 31.3 31.8 31.9 31.9 33
Open search router TTI Load Search Options Baseline
Mean: 107.063 ms
Stdev: 6.185 ms (5.8%)
Runs: 95.26542199961841 95.29349800013006 96.24951200000942 96.64969899877906 96.88574200123549 97.1992190014571 97.38374900072813 98.62284300103784 99.46228099986911 99.58829700015485 99.80619299970567 99.94897400029004 101.88814299926162 102.80082199908793 103.37670899927616 104.19307499937713 104.64522300101817 105.33443199843168 105.44234200008214 105.45483399927616 105.5530599988997 106.22107000090182 106.5012610014528 106.54671199992299 106.72127199918032 107.00476100109518 107.23608399927616 108.05834900029004 108.21577999927104 108.5735680013895 108.80912300013006 108.81188900023699 109.0480550006032 109.25764999911189 109.36840800009668 109.71476300060749 109.87056500092149 110.08780900016427 110.17891499958932 110.2242019996047 110.40250699967146 110.5605059992522 110.72794599831104 110.84965000115335 110.89359500072896 111.29618299938738 112.9468590002507 114.36942499876022 114.58890699967742 114.84000699967146 115.50374400056899 116.04813599959016 116.64038100093603 116.78348800167441 118.01013099960983 119.57918300107121

Current
Mean: 108.681 ms
Stdev: 5.684 ms (5.2%)
Runs: 93.987549001351 94.34610999934375 95.49405900016427 96.10213200002909 101.25288899987936 101.74043799936771 102.87548799999058 103.63098100014031 104.45288099907339 104.77864599972963 104.78511600010097 104.91381799988449 105.12247700057924 105.23783300071955 105.50240099988878 105.72281900048256 105.78483000025153 106.76281700097024 106.76395699940622 106.87508200109005 107.00907399877906 107.25419100001454 107.90279100090265 107.91357400082052 108.10717800073326 108.25244100019336 109.0148929990828 109.0680330004543 109.10978199914098 109.23555499874055 109.5703940000385 109.65323900058866 109.7987879998982 109.88537600077689 109.91764299944043 110.02083300054073 111.48002200014889 111.54654899984598 111.71350099891424 111.84191900119185 111.87601699866354 112.38216100074351 112.52795400097966 112.71773300133646 113.58797200024128 115.04423000104725 115.04785200022161 115.40983100049198 115.45951299928129 115.8618170004338 115.97200500033796 116.33028100058436 116.45259599946439 117.43135599978268 117.45800800062716 118.12768599949777
Open search router TTI Open Search Router TTI Baseline
Mean: 531.238 ms
Stdev: 47.967 ms (9.0%)
Runs: 410.9779460001737 432.5448809992522 442.7363280002028 452.5523689985275 460.14522399939597 462.3707280009985 472.28918500058353 474.4135740008205 484.8205570001155 487.0622559990734 491.35701599903405 493.11670000106096 498.6421719994396 502.5460609998554 503.3672690000385 504.72461000084877 507.1141349989921 507.75325599871576 512.2410490009934 512.7956550009549 513.6658530011773 514.062743999064 514.9463299997151 520.0442709997296 520.4486490003765 525.3823659997433 530.8294280003756 531.2753899991512 532.7813729997724 533.8852939996868 536.3580729998648 539.0025629997253 541.0637619998306 543.4949950017035 544.3018800001591 544.9763590004295 547.6831459999084 551.0368249993771 552.9242349993438 554.4087729994208 559.7685960009694 561.5644129998982 563.0804439987987 566.0757250003517 567.1546229999512 569.7584230005741 570.3770340010524 582.378824999556 584.1277259998024 587.960165001452 588.700317999348 597.1629230007529 597.8753660004586 610.8780930005014 612.6328530013561 620.9606529995799 633.9507250003517

Current
Mean: 518.425 ms
Stdev: 58.231 ms (11.2%)
Runs: 405.69063299894333 410.0903320014477 411.00370300002396 424.7158620003611 438.58178699947894 440.4648850001395 450.2060550004244 452.6030679997057 452.65743100084364 453.05057800002396 453.8137209992856 457.1419680006802 457.78251099959016 460.58085099980235 462.5239260010421 464.22579000145197 465.953857999295 472.0129799991846 475.0277510005981 483.76432400010526 483.7676590010524 506.74963400140405 510.3115640003234 511.48034700006247 515.4862880017608 516.2932940013707 519.8099370002747 523.6621499992907 524.511921999976 525.4152429997921 529.4200439993292 532.0963550005108 535.0194899998605 535.1005859989673 535.5454099997878 538.4809980001301 541.4401040002704 543.7285160012543 544.2049969993532 546.6988120004535 548.0534669999033 549.3062749989331 553.6380620002747 556.1416419986635 560.6648770011961 562.801067000255 562.956664999947 567.8039549998939 569.0384519994259 569.9027920011431 571.0277919992805 574.7803150005639 577.2685139998794 578.1584879998118 578.847331000492 583.0989990010858 592.8966070003808 624.1236169990152 650.1646320000291 663.6942139994353
Open search router TTI (CPU) Baseline
Mean: 137.131 %
Stdev: 4.669 % (3.4%)
Runs: 127.7506266046862 127.79690189328747 127.86810908277432 128.83481524091448 130.20781686962434 130.55590910605284 130.72100212427037 130.93719021030907 132.3584069969334 132.4063718777821 133.291341913657 133.3250151091881 133.4639562553128 133.63661005395292 133.9137946298479 134.24652718688847 134.5419657398691 134.5922674771823 134.8693088410991 135.00929614873831 135.19224327378197 135.28273778037737 135.3287915869814 135.49602691108208 135.68511091646337 135.813278777868 135.81375885088306 136.20648727256057 136.38388479758592 136.67914424249557 136.7083169629215 136.84250155648786 137.23185434075214 137.68298004151455 138.34720870066016 138.35045010988736 138.7747071957598 138.8194568838731 139.87993978935245 140.25747739888314 140.3049377137749 140.33518190265667 140.46318021720765 140.59157029464015 140.6223270554293 140.62408120995937 141.25538956896898 141.40154630932963 141.51206304187534 141.64469197947489 141.71470006154902 142.1011506899307 142.35384516590312 142.73621066547145 143.59899601953973 143.60397951384863 143.62764316731585 144.29003294930345 146.22957960197243 147.73733446401812

Current
Mean: 135.415 %
Stdev: 4.236 % (3.1%)
Runs: 127.05946586083692 128.8258136614512 128.94962474824493 129.00361973508265 129.06946849263292 129.25212392077552 129.25767062242548 130.30439121756496 131.5617717066006 131.61806778935582 131.80119202548528 131.87524950099805 131.895300308474 132.30417892637078 132.33089711682905 132.35164583348785 132.95864693196052 133.0052916526999 133.27281065068473 133.3055570000519 133.4937110496774 133.88342898295 134.22669069270853 134.2317034187338 134.36270516895323 134.57918042725166 134.60086152793602 134.7337499432397 134.9413157744882 135.01416542103556 135.05199431995874 135.06230509460084 135.0781970158582 135.30636666409276 135.47184593680797 135.58540062731686 136.08201726018152 136.18153509376285 136.43044772179096 136.44335255874884 136.50325142235687 136.72777636935507 136.987682987657 137.0448857984979 137.11958426362526 137.39622095787152 138.1553330618697 139.1203223398925 139.36026747779346 140.0471860624378 140.21503382271035 140.94894483784907 141.443867786894 141.71040629850702 141.90065007298017 142.95560805653966 143.8244141637984 143.87413122762004 143.88296426765083 144.90332562174726
Open search router TTI (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Open search router TTI (RAM) Baseline
Mean: 364.304 MB
Stdev: 4.784 MB (1.3%)
Runs: 352.84375 354.0807291666667 354.8932291666667 357.2239583333333 358.228515625 358.517578125 358.5442708333333 359.1318359375 359.5634765625 360.0283203125 360.3935546875 361.1572265625 361.158203125 361.2275390625 361.2451171875 361.326171875 361.421875 361.427734375 361.611328125 361.751953125 362.39453125 362.4619140625 362.681640625 362.81640625 362.92578125 363.009765625 363.310546875 363.5107421875 363.8251953125 363.9365234375 363.96484375 364.37109375 364.3916015625 364.478515625 365.05859375 365.6630859375 365.779296875 365.8046875 365.99609375 366.0947265625 366.111328125 366.3984375 366.462890625 366.7392578125 366.7587890625 367.1611328125 367.216796875 367.3564453125 368.38671875 368.4013671875 368.6302083333333 369.1640625 369.5859375 370.8759765625 371.91015625 372.9111328125 373.5833333333333 373.8525390625 373.8798828125 374.6005859375

Current
Mean: 365.687 MB
Stdev: 3.039 MB (0.8%)
Runs: 360.5517578125 360.6123046875 360.681640625 360.79296875 361.2041015625 361.55078125 361.81640625 362.3017578125 362.3623046875 362.5859375 362.6015625 362.6318359375 363.1708984375 363.3154296875 363.3681640625 363.787109375 363.8173828125 363.955078125 364.041015625 364.1458333333333 364.3056640625 364.5302734375 364.7099609375 364.734375 364.7513020833333 364.921875 364.9921875 365.2822265625 365.349609375 365.6611328125 365.71484375 365.7255859375 366.0849609375 366.09765625 366.26953125 366.62109375 366.7005208333333 366.9326171875 366.951171875 367.1318359375 367.1630859375 367.5810546875 367.6123046875 367.67578125 367.841796875 367.9677734375 368.041015625 368.49609375 368.5205078125 369.4892578125 369.505859375 369.80078125 370.1337890625 370.23046875 370.580078125 370.84375 372.2568359375 373.3662109375
Open search router TTI (CPU/JS) Baseline
Mean: 70.886 %
Stdev: 2.186 % (3.1%)
Runs: 65.9 66 66.2 66.9 67.1 67.1 67.5 67.9 68.7 69.1 69.2 69.4 69.5 69.8 69.8 69.9 69.9 70 70.2 70.2 70.3 70.4 70.4 70.4 70.6 70.7 70.8 71 71.1 71.1 71.2 71.4 71.4 71.7 71.9 71.9 71.9 71.9 72.1 72.1 72.4 72.5 72.5 72.5 72.5 72.9 73 73.1 73.2 73.4 73.5 73.6 73.8 73.8 74.1 74.4 74.7

Current
Mean: 69.365 %
Stdev: 2.610 % (3.8%)
Runs: 64.9 65 65.4 65.4 65.5 65.8 66.2 66.3 66.3 66.3 66.4 66.4 66.7 66.8 67 67.3 67.6 67.8 68.1 68.3 68.5 68.6 68.6 68.8 68.9 68.9 69.1 69.1 69.2 69.3 69.3 69.5 69.7 69.8 69.9 69.9 70 70 70 70.3 70.4 70.5 70.8 70.8 71 71.1 71.5 71.5 71.5 71.7 71.8 72 72.1 72.1 72.4 73.9 74.1 74.3 75.5 76
Open search router TTI (CPU/UI) Baseline
Mean: 27.258 %
Stdev: 1.692 % (6.2%)
Runs: 23.9 23.9 24.3 24.4 24.4 24.9 24.9 25.2 25.4 25.4 25.4 25.4 25.9 25.9 26 26 26.3 26.3 26.4 26.4 26.4 26.4 26.5 26.8 26.9 26.9 27 27 27 27 27.5 27.7 27.8 27.8 27.9 28 28 28.1 28.1 28.3 28.3 28.3 28.4 28.4 28.5 28.5 28.5 28.6 28.7 28.7 28.8 29 29.2 29.4 29.5 29.9 30 30 30.4 30.6

Current
Mean: 26.613 %
Stdev: 1.735 % (6.5%)
Runs: 22.9 23.6 23.7 23.8 23.9 24 24 24.4 24.5 24.8 24.8 24.9 25 25.3 25.3 25.4 25.4 25.4 25.5 25.9 25.9 26 26.1 26.1 26.4 26.4 26.4 26.4 26.4 26.8 26.8 26.9 26.9 26.9 27 27.1 27.4 27.4 27.4 27.5 27.5 27.5 27.7 27.8 27.8 27.8 27.9 28 28.1 28.2 28.5 28.6 28.7 28.7 28.8 29.4 29.5 29.7 29.8 30.1
Report typing Composer typing rerender count Baseline
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

Current
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
Report typing Message sent Baseline
Mean: 390.461 ms
Stdev: 27.012 ms (6.9%)
Runs: 347.95454899966717 350.15877299942076 354.05594899877906 354.8381350003183 355.64343299902976 360.5562750007957 360.9294429998845 361.1822510007769 362.734211999923 363.10136000066996 363.17529300041497 364.1347250007093 364.5380450002849 364.75594099983573 365.1416020002216 366.5334070008248 366.90690200030804 368.0243330001831 368.9303389992565 372.15698199905455 374.52758800052106 375.5809739995748 376.8830570001155 376.97298200055957 377.63802099972963 378.6077069994062 379.9420580007136 380.31058800034225 380.3909910004586 381.03629600070417 385.17472299933434 386.24641999974847 387.6886390000582 388.4267990011722 393.4327400010079 396.7717279996723 398.98348000086844 401.70377700030804 402.4008799996227 407.3308920003474 407.3386640008539 407.8922119997442 408.6334639992565 409.5704340003431 412.29068999923766 414.32560200057924 414.9052739981562 418.25805599987507 418.7129730004817 422.4081629998982 422.61507200077176 423.0730799995363 423.9312750007957 425.42793800123036 429.8605550006032 430.5911060012877 435.61092099919915 443.5727949999273 445.6558429989964 447.46553600020707

Current
Mean: 387.255 ms
Stdev: 26.093 ms (6.7%)
Runs: 343.2396250013262 343.6315919999033 351.84513400122523 352.0862630009651 353.72440600022674 354.94038899987936 355.27571700140834 355.3757729995996 357.9116619993001 358.13655599951744 360.0558269992471 360.44136600010097 360.9108479991555 361.60766600072384 367.50484200008214 367.85782900080085 367.86360700055957 368.77587899938226 371.3769129998982 371.37772599980235 372.2422289997339 372.7732749991119 373.4348150007427 374.6389170009643 377.43351200036705 378.7526450008154 379.24629699997604 380.21224000118673 381.47843400016427 382.3419589996338 383.45922899991274 384.1097820010036 384.2675790004432 384.48238199949265 387.69360399991274 395.5345470011234 397.1810710001737 401.6785889994353 402.8162839990109 403.5067139994353 404.0063070002943 404.2344569992274 405.327677000314 405.9292399995029 409.4672449994832 410.47375500015914 410.7113850004971 410.88761400058866 411.9003500007093 415.2114669997245 415.71232200041413 417.34029099904 419.4438069984317 420.22981799952686 420.36962899938226 420.85998499952257 423.6228029988706 434.31030300073326 436.07535899989307 457.95194500125945
Report typing (CPU) Baseline
Mean: 96.033 %
Stdev: 3.633 % (3.8%)
Runs: 88.70725285264157 89.77197907477449 89.79874817426374 90.20366935067959 90.62089913975875 90.70782909020555 91.41691794645484 91.44219524241205 91.97873883597512 92.21020598401176 92.61865456477959 92.70726395767649 93.28779086533874 93.5962015974935 93.68096525710725 93.85348351194371 94.14149662864988 94.32454613589721 94.37551489993272 94.58408583472583 94.88714739077557 94.91936275312806 94.93667194045972 95.01630575902085 95.3915967449662 95.53381488714675 95.58148602386464 95.62451996072708 95.68116086389698 95.68617542501376 95.75788476140315 95.76166698254438 95.78708128433178 95.94021368640175 96.08215946924501 96.41939425613042 96.63000009139012 96.93047821146851 97.0278474977378 97.06793506747762 97.32689031668995 97.48213872695409 97.67163643477247 97.95408049469842 97.98009792563964 99.01116382319486 99.23784251185242 99.28265410922104 99.85471315366586 100.72477196461718 100.81183597111135 101.49283460101915 101.53511035725825 101.59082160089889 101.67346050642155 102.63674728963571 102.78024087647387 103.04583666455584 103.1361018906257

Current
Mean: 95.648 %
Stdev: 3.637 % (3.8%)
Runs: 89.12174019520155 89.18638692912317 89.20912563754042 89.37442785323115 90.2641613255639 90.35413165133602 90.50381889607429 90.8291623827079 90.87111132101191 91.55586808431967 91.69136999279823 91.9215550606605 92.33364071708746 92.57823017554325 92.62722599041116 93.45017377306431 93.50787030390434 94.16594394181708 94.43279728813646 94.4801057502126 94.5840769510977 94.67108815888834 94.82380519202542 94.92183647787758 94.93088556891864 94.93548163313514 94.985354292616 95.38221472727123 95.8041196072499 95.83069883099886 95.96384925455203 96.23679514621006 96.26182939489424 96.5039041699366 97.04601802452878 97.06413429419138 97.1061224705411 97.10616065009333 97.32468235066564 97.42221237533806 97.4568210216628 97.56830226312226 97.5838638178027 97.82116962080761 98.02054318535254 98.29813078379308 98.51703584135139 98.51931377437951 98.70081230253209 98.91366676233689 99.11399047704869 99.66209141480483 99.89521054543565 99.94447395898939 99.97392892357435 100.67178379402422 101.89654229045475 104.30558359800257 105.02717664674071
Report typing (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Report typing (RAM) Baseline
Mean: 501.722 MB
Stdev: 10.426 MB (2.1%)
Runs: 486.6892361111111 486.96636284722223 487.58897569444446 488.673828125 488.8674045138889 489.0447048611111 489.1037326388889 489.14366319444446 489.68511284722223 489.8732638888889 489.89171006944446 490.50151909722223 491.2272135416667 491.5696614583333 491.8634982638889 492.1087239583333 493.626953125 494.4583333333333 494.5729166666667 494.7265625 494.8865017361111 495.76171875 496.232421875 497.53949652777777 498.0462239583333 498.40439967105266 498.76295230263156 498.9001736111111 499.4938322368421 500.43663194444446 501.0065104166667 501.2165798611111 502.62196180555554 503.08940972222223 503.22894965277777 503.5891927083333 503.6369357638889 504.458984375 506.3294270833333 506.6712239583333 507.02734375 507.171875 508.40581597222223 508.759765625 509.115234375 509.8020833333333 510.2408854166667 510.75889756944446 510.8650173611111 513.0145399305555 513.4600694444445 514.0618489583334 515.1217447916666 515.9989720394736 516.8489583333334 517.4212239583334 518.6844618055555 519.2723524305555 521.4010416666666 531.385009765625

Current
Mean: 502.258 MB
Stdev: 9.462 MB (1.9%)
Runs: 486.6953125 487.10590277777777 487.5455729166667 487.63671875 488.3463541666667 488.4108072916667 488.70811631944446 491.28125 492.96571180555554 493.16514756944446 493.822265625 494.02235243055554 494.69227430555554 494.87196180555554 494.8747829861111 494.92664930555554 495.7734375 495.8025173611111 496.1751302083333 496.1875 497.06597222222223 498.70333059210526 498.82313368055554 499.1540798611111 499.4508634868421 499.63910590277777 500.02842881944446 500.1334635416667 500.60503472222223 500.89561631944446 502.3385416666667 502.4450954861111 502.6169704861111 502.6232638888889 502.7209201388889 502.90581597222223 504.06792534722223 504.23741319444446 504.599609375 504.603515625 505.31011284722223 505.6302083333333 505.68402777777777 505.74652777777777 506.8478732638889 508.5813802083333 511.0110677083333 511.078125 513.3823784722222 514.2534722222222 514.3674045138889 515.146484375 515.5243055555555 516.4474826388889 517.2146267361111 517.9913194444445 518.0787760416666 518.6911892361111 520.4516059027778 523.3734809027778
Report typing (CPU/JS) Baseline
Mean: 44.215 %
Stdev: 2.622 % (5.9%)
Runs: 38.8 39.5 40.4 40.4 40.5 40.7 40.7 41.2 41.3 41.3 41.6 42 42.1 42.2 42.4 42.5 42.5 42.5 42.7 42.7 42.7 42.7 42.8 42.9 43.1 43.2 43.4 43.6 43.6 43.9 44.1 44.1 44.5 45.1 45.2 45.2 45.3 45.3 45.5 45.7 45.8 45.8 46.1 46.2 46.2 46.5 46.6 47 47.3 47.3 47.4 47.5 47.7 48 48.2 48.3 48.6 49.1 49.2

Current
Mean: 44.307 %
Stdev: 2.760 % (6.2%)
Runs: 36.6 39.6 40.3 40.3 40.5 40.9 41 41.2 41.3 41.3 41.3 41.3 41.6 41.6 41.8 41.8 42.2 42.5 42.6 42.7 43 43.2 43.2 43.6 43.8 44 44.2 44.3 44.4 44.5 44.5 44.6 44.6 44.9 45.1 45.1 45.4 45.5 45.5 45.6 45.8 45.9 45.9 45.9 46.1 46.8 46.8 47 47.1 47.3 47.4 47.5 47.8 47.8 48 48.6 48.6 48.6 49 49.1
Report typing (CPU/UI) Baseline
Mean: 23.878 %
Stdev: 1.296 % (5.4%)
Runs: 21.2 21.4 21.6 21.7 21.7 21.8 21.8 21.9 22 22 22.2 22.4 22.7 22.7 22.8 23 23.4 23.5 23.5 23.5 23.7 23.8 23.8 23.8 23.8 23.8 23.9 23.9 24 24 24.1 24.2 24.2 24.3 24.4 24.4 24.4 24.4 24.5 24.5 24.5 24.6 24.7 24.8 24.8 24.8 24.9 24.9 24.9 24.9 24.9 25.3 25.3 25.3 25.6 25.6 25.7 26 26.2 26.3

Current
Mean: 23.905 %
Stdev: 1.118 % (4.7%)
Runs: 21.2 21.7 21.9 22.1 22.1 22.2 22.2 22.3 22.4 22.5 22.5 22.6 22.6 22.7 22.9 23 23 23.1 23.5 23.6 23.7 23.7 23.8 23.9 23.9 24.1 24.2 24.2 24.3 24.3 24.3 24.3 24.3 24.4 24.4 24.4 24.4 24.5 24.5 24.5 24.5 24.7 24.7 24.7 24.7 24.7 24.8 24.8 24.9 25 25 25.1 25.1 25.1 25.1 25.2 25.3 25.5 25.5 25.7
Chat opening Chat TTI Baseline
Mean: 473.612 ms
Stdev: 32.149 ms (6.8%)
Runs: 397.36897799931467 404.42069599963725 405.4989010002464 418.1656499989331 419.1973880007863 424.36934399977326 426.8504230007529 433.51395700126886 433.57983399927616 436.07454499974847 437.39489700086415 443.813395999372 445.6694740001112 449.0924489982426 449.88537700101733 453.66841600090265 454.6750900000334 454.8212899994105 455.1025799997151 459.0404460001737 459.5799959991127 466.125 467.5481770001352 467.85058600082994 469.7207030002028 472.2753500007093 474.1831470001489 476.71537300013006 477.5561939999461 479.8573400005698 480.6519370004535 480.6980390008539 481.13586499914527 485.06860399991274 488.23738599941134 489.1680510006845 491.1999099999666 491.52872700057924 494.0554600004107 494.3769940007478 494.547770999372 495.43330899998546 496.4519449993968 498.046427000314 499.5300290007144 500.8551850002259 501.04406799934804 501.9193929992616 504.6092939991504 504.722779000178 505.07751500047743 505.61324100010097 506.800660001114 507.5570069998503 510.79935699887574 512.8084309995174 513.3443200010806 515.2456049993634 519.5239669997245 533.0590420011431

Current
Mean: 475.277 ms
Stdev: 28.449 ms (6.0%)
Runs: 402.625326000154 406.8114829994738 422.64396199956536 431.40340200066566 438.18277999944985 439.3861090000719 439.4730630014092 444.36311800032854 447.12255899980664 447.9287109989673 448.56510400027037 448.94441800005734 449.2380779981613 450.81404700130224 451.09810400009155 454.63472499884665 458.35656700097024 458.77962299995124 459.2655840013176 460.55074100010097 460.89290300011635 461.07311999984086 463.99361199885607 464.35750399902463 464.39318799972534 470.06978400051594 470.58365900069475 475.17094000056386 476.0657150000334 482.05676299892366 482.2215580008924 485.08190900087357 485.16853899881244 486.07531799934804 488.3408199995756 490.5769039988518 491.02079300023615 491.1895759999752 492.015746999532 492.0950930006802 492.44421400129795 495.33992599882185 496.688069999218 496.69950399920344 499.20450799912214 499.4864509999752 499.5109059996903 501.8733719997108 502.531697999686 503.4409179985523 503.9793299995363 504.63614999875426 507.7754730004817 509.76908399909735 511.84733099862933 517.100912000984 519.144695000723 522.6261400002986 524.6312669999897
Chat opening (CPU) Baseline
Mean: 141.528 %
Stdev: 4.444 % (3.1%)
Runs: 128.9500121696151 133.20822219737747 134.43908606280596 135.1454569164889 135.3935193301212 135.58708329435248 135.80390410450536 136.29702970297024 136.75882558315715 136.92404930659958 136.93227091633457 136.93409793562657 137.2695689589914 137.5133282200591 137.99877995977104 138.1945726869012 138.49008429707462 138.58973040973842 138.7111733838 138.94595510716198 139.23965832608468 139.24483721501122 140.1002856552272 140.1468275195811 140.3858948769129 140.5315068577179 140.87858084898863 141.01583791138768 141.0659019367615 141.4154818030174 141.82080380772908 142.31859810539055 142.3577566820227 142.8879172788451 143.2496918513571 143.5984549832155 143.88620430394107 144.0329061525147 144.11516296041844 144.22870360692502 144.68853094041214 144.8165726112504 144.83211645167628 145.03266341964274 145.0349352552978 145.18710051104196 145.219408777269 145.36823676428386 145.79054148799756 145.82468465327446 145.83858267367063 146.70646458327255 146.86504939708377 147.45123901791663 147.48292474476787 147.54181051216162 147.82053741546318 147.85569187687773 148.08618763886955 149.59969981903924

Current
Mean: 141.536 %
Stdev: 4.708 % (3.3%)
Runs: 129.87366772227327 132.55097540644311 133.0264685947646 133.37018521155025 133.61055666444892 133.8813839819789 134.3090097887481 135.1709468423136 135.23134760222376 135.96446981569318 136.03239479624582 136.32869369765422 137.8164822266934 137.85860776020917 138.07819329478295 138.1326747194207 138.7155179534901 139.14803151276098 139.42664019995007 139.49962018252648 139.76787180122056 140.2632162311701 140.35047273296183 140.69206255310394 140.71319981186264 140.97582776893623 141.2532642162442 141.93954466829214 142.3394341355301 142.43617015879036 142.84812909828182 143.01814234960077 143.2028555072072 143.68908479570462 143.7693225922009 143.77759503069876 143.84670304970288 143.87131247515788 144.29090822163113 144.33739434498762 144.3811549861012 144.52451293516438 144.81019812509635 144.98162220762845 145.01222531784964 145.07444017259652 145.3015374685753 145.30835949596394 145.42646140655484 146.2673981139305 146.46378737690392 146.73793450365363 147.0061884263602 147.19743806891591 147.2425511101649 147.5256487411223 147.60788780064192 147.60817336713745 148.86740275632425 149.41538340021685
Chat opening (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Chat opening (RAM) Baseline
Mean: 371.862 MB
Stdev: 12.966 MB (3.5%)
Runs: 350.6419270833333 351.08203125 351.9270833333333 352.2317708333333 352.328125 352.5299479166667 353.078125 353.2057291666667 353.3658854166667 353.5416666666667 354.3177083333333 354.4479166666667 354.83203125 354.8763020833333 359.23828125 360.4348958333333 361.3190104166667 362.85546875 363.9934895833333 365.43359375 365.6744791666667 366.8216145833333 367.2356770833333 368.5416666666667 368.9752604166667 369.8346354166667 370.6002604166667 370.7916666666667 371.0364583333333 371.5104166666667 371.9466145833333 378.3932291666667 379.2705078125 379.3359375 379.9599609375 380.650390625 382.453125 382.7255859375 383.060546875 383.0830078125 383.3037109375 383.41796875 383.8291015625 383.98828125 384.0361328125 384.0712890625 384.0830078125 384.12890625 384.3759765625 384.4912109375 384.7890625 384.8076171875 385.2080078125 385.23046875 385.3681640625 386.017578125 387.2939453125 387.6025390625 387.646484375 390.4541015625

Current
Mean: 376.791 MB
Stdev: 12.809 MB (3.4%)
Runs: 355.6510416666667 356.5716145833333 356.9192708333333 356.9661458333333 356.9817708333333 357.359375 359.1380208333333 359.16015625 359.7903645833333 360.8255208333333 361.4609375 361.60546875 362.0286458333333 362.4518229166667 362.705078125 363.1458333333333 363.3151041666667 364.0130208333333 364.3984375 364.484375 365.2552083333333 368.07421875 370.5651041666667 370.98828125 371.2356770833333 377.8017578125 383.4921875 383.73046875 384.193359375 385.28515625 385.63671875 385.8828125 385.90625 385.9853515625 385.9951171875 386.421875 386.5302734375 386.7919921875 386.8173828125 386.90625 386.9404296875 387.0654296875 387.107421875 387.28515625 387.603515625 387.75390625 387.919921875 388.0029296875 388.4130859375 388.4951171875 388.583984375 388.6904296875 388.8076171875 389.177734375 389.2021484375 389.623046875 389.818359375 390.1611328125 391.453125 392.8994140625
Chat opening (CPU/JS) Baseline
Mean: 70.827 %
Stdev: 2.754 % (3.9%)
Runs: 65.9 66.3 67 67.1 67.2 67.2 67.2 67.2 67.3 67.3 67.4 68.4 68.5 68.6 68.6 68.7 68.7 68.8 68.9 69 69.1 69.1 69.5 69.7 69.8 70.1 70.2 70.3 70.4 70.6 70.8 70.9 71 71.3 71.4 71.5 71.7 71.8 71.9 71.9 72.3 72.7 73 73.1 73.3 73.3 73.4 73.5 73.8 73.9 74 74.1 74.2 74.4 74.5 74.5 74.6 75.8 75.9 77

Current
Mean: 70.062 %
Stdev: 2.742 % (3.9%)
Runs: 64.1 64.5 65 66 66.1 66.2 66.5 67.2 67.2 67.4 67.4 67.4 67.5 67.8 67.9 68 68 68.1 68.2 68.2 68.5 68.6 68.7 68.8 69 69.1 69.4 69.9 70 70.2 70.6 70.6 70.9 70.9 70.9 71.1 71.1 71.4 71.5 71.5 71.7 71.9 72 72.1 72.2 72.4 72.4 72.6 72.8 72.9 72.9 73.3 73.5 73.6 73.9 74 74.2 74.4 74.6 74.9
Chat opening (CPU/UI) Baseline
Mean: 28.292 %
Stdev: 1.348 % (4.8%)
Runs: 25.2 26 26.3 26.4 26.4 26.6 26.6 26.8 26.9 26.9 26.9 27 27 27.1 27.3 27.3 27.4 27.4 27.5 27.6 27.7 27.8 27.8 27.8 27.8 27.9 27.9 27.9 28 28 28 28 28.2 28.3 28.4 28.5 28.6 28.8 28.9 28.9 29 29.3 29.3 29.3 29.4 29.5 29.6 29.7 29.7 29.8 29.9 29.9 29.9 29.9 30.2 30.2 30.5 30.8 30.9 30.9

Current
Mean: 28.409 %
Stdev: 1.312 % (4.6%)
Runs: 25.7 25.8 26 26.3 26.3 26.5 26.8 27 27.1 27.2 27.3 27.3 27.3 27.5 27.7 27.7 27.8 27.9 27.9 27.9 28 28 28.3 28.3 28.3 28.3 28.3 28.3 28.4 28.4 28.4 28.4 28.5 28.5 28.6 28.6 28.7 28.8 28.9 28.9 28.9 28.9 29.2 29.4 29.4 29.6 29.7 29.8 29.8 29.9 29.9 30.3 30.6 30.7 30.9 31 31.4
Linking (CPU) Baseline
Mean: 149.157 %
Stdev: 3.075 % (2.1%)
Runs: 141.62260786375555 142.06171887350862 142.18996475413334 143.3175445396556 144.2180156949397 144.99708145535158 145.01316874249187 145.5448218806119 145.76999333675678 146.6058701558358 146.69321583543567 146.75315453940786 146.8671003152157 147.01734239570806 147.13859193085477 147.20356613431213 147.34160668131676 147.52516509549275 147.8669643094291 148.09937892614656 148.1004169249811 148.22550755403032 148.44674888613966 148.54307585696623 148.7849753317911 148.9176293628806 148.95778861739663 149.28312813621602 149.34650175849046 149.41449185633877 149.4304587039129 149.6296081940244 149.75933785518785 149.87144004312879 150.08575848753333 150.15001367276392 150.2018141783743 150.33766769104338 150.4463559990166 150.47160110886375 150.57786736164485 150.64727043373205 150.8026789535179 151.04686563128732 151.07772074647391 151.28763914754092 151.44091090059268 151.74491523871072 152.1719627968634 152.2545544873934 152.5360003737987 152.54998832284915 152.5733886077246 153.11511389134927 153.21288264678896 153.42057662696095 153.60105805562438 153.74542945648878 153.9385067141957 155.41745797235163

Current
Mean: 147.272 %
Stdev: 3.061 % (2.1%)
Runs: 139.5066392400547 141.02944302990295 141.0690865487804 142.01621784457038 143.12050075659172 143.15186383316882 143.26922724917156 143.35268410754026 143.39704432687213 143.4190529714305 144.5752284325691 144.6067859498026 144.7163697527754 145.05633400814907 145.28745831921862 145.43862263820682 145.58673050085653 145.70024393543503 146.11859317299857 146.45012645477715 146.76923706749798 146.7717412269053 146.91978239569065 147.15140143027926 147.1949368646514 147.2182435334323 147.3083289095547 147.33157206741666 147.47183248024302 147.49564712051165 147.827275302411 147.8956186773653 147.90431468094206 148.10653746833037 148.1513601748885 148.35646733495946 148.57862001878598 148.65570999558284 148.66409173887683 148.8337913606221 148.94778113825572 149.32563575779707 149.3321045819407 149.41763641571126 149.53949793438295 149.64117156589472 149.68608636730156 149.7054312061064 150.10461843598074 150.10561836970817 150.3150415650374 151.00491861767708 151.0053635261327 151.14375882796682 151.472831827173 152.6683405000351 153.11095772437366 153.76314567582097
Linking (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Linking (RAM) Baseline
Mean: 411.608 MB
Stdev: 9.776 MB (2.4%)
Runs: 394.484375 396.084375 398.0203125 398.08046875 398.95625 399.5203125 399.55546875 399.63984375 399.6921875 399.7890625 399.92109375 400.4390625 400.61640625 400.67109375 401.296875 401.571875 401.625 401.68203125 401.9578125 402.04375 402.534375 403.11875 404.11015625 405.6578125 408.015625 409.7083333333333 411.27890625 411.56171875 413.2174479166667 413.6315104166667 414.7203125 415.9329427083333 416.78515625 417.1204427083333 417.1686197916667 417.74765625 419.03515625 419.6783854166667 419.8046875 419.8157552083333 420.0377604166667 420.3209635416667 420.9505208333333 420.9654947916667 421.33203125 421.3326822916667 421.5484375 421.6920572916667 421.8782552083333 421.9134114583333 421.9733072916667 422.07734375 422.294921875 422.634765625 422.634765625 422.7141927083333 422.9830729166667 423.0651041666667 423.3756510416667 424.4796875

Current
Mean: 424.380 MB
Stdev: 3.181 MB (0.7%)
Runs: 417.2799479166667 417.3294270833333 417.70703125 418.6640625 419.1080729166667 420.013671875 420.8190104166667 420.9908854166667 421.2356770833333 421.3216145833333 421.5494791666667 421.8977864583333 422.0221354166667 422.5494791666667 422.6002604166667 422.96484375 423.753125 423.876953125 423.9427083333333 424.1399739583333 424.1549479166667 424.2897135416667 424.3092447916667 424.4680989583333 424.4889322916667 424.6061197916667 424.646484375 424.693359375 424.7779947916667 425.2135416666667 425.2877604166667 425.4622395833333 425.5364583333333 425.662109375 425.822265625 425.8997395833333 426.021484375 426.044921875 426.075 426.2389322916667 426.3313802083333 426.369140625 426.57421875 426.734375 426.767578125 427.298828125 427.375 427.6549479166667 428.15234375 428.5104166666667 429.556640625 431.2272135416667 432.1412760416667
Linking (CPU/JS) Baseline
Mean: 80.110 %
Stdev: 1.791 % (2.2%)
Runs: 76.3 76.7 77 77.2 77.3 77.4 77.5 78 78.1 78.1 78.1 78.3 78.8 78.9 79.1 79.2 79.2 79.3 79.4 79.4 79.4 79.5 79.5 79.5 79.5 79.5 79.5 79.7 79.9 79.9 80.2 80.3 80.3 80.4 80.5 80.6 80.7 80.7 80.8 80.9 81 81 81.3 81.3 81.4 81.5 81.6 81.6 81.8 81.8 81.9 81.9 82.1 82.2 82.6 83.2 83.2 83.4 83.5 83.7

Current
Mean: 80.902 %
Stdev: 1.518 % (1.9%)
Runs: 76.8 77 78 78.6 78.7 78.7 78.7 78.8 79.2 79.3 79.5 79.6 79.6 79.7 79.8 80 80 80 80.3 80.3 80.4 80.4 80.5 80.6 80.6 80.6 80.8 81 81.1 81.1 81.2 81.2 81.3 81.5 81.5 81.6 81.6 81.6 81.8 81.9 81.9 82 82 82 82 82.1 82.3 82.3 82.3 82.5 82.5 82.6 82.6 82.6 82.7 82.8 82.8 82.9 83 83.3
Linking (CPU/UI) Baseline
Mean: 28.352 %
Stdev: 1.712 % (6.0%)
Runs: 24.8 25.3 25.5 25.8 25.9 26 26.1 26.5 26.6 26.7 26.7 26.8 26.9 26.9 27 27.1 27.1 27.1 27.1 27.3 27.5 27.6 27.8 27.9 27.9 27.9 27.9 28.2 28.3 28.3 28.3 28.3 28.3 28.5 28.6 28.6 28.6 28.7 28.7 28.9 29.3 29.4 29.4 29.4 29.5 29.6 30.3 30.3 30.3 30.3 30.3 30.4 30.4 30.6 30.6 30.9 31.2 31.4 31.5 32

Current
Mean: 27.405 %
Stdev: 0.958 % (3.5%)
Runs: 24.7 25.5 25.8 25.9 26.2 26.2 26.2 26.3 26.4 26.5 26.6 26.6 26.6 26.7 26.7 27 27 27.1 27.1 27.1 27.1 27.2 27.2 27.3 27.4 27.4 27.5 27.5 27.5 27.5 27.5 27.6 27.6 27.6 27.6 27.6 27.8 27.8 27.8 27.8 27.9 27.9 27.9 28 28.2 28.3 28.3 28.3 28.5 28.6 28.6 28.8 28.9 29.2 29.3 29.5

Copy link
Contributor

@Expensify/mobile-deployers 📣 Please look into this performance regression as it's a deploy blocker.

@Julesssss Julesssss removed the DeployBlockerCash This issue or pull request should block deployment label Nov 19, 2024
@Julesssss
Copy link
Contributor

This PR didn't reduce perf by 19% -- we made simple modifications to the location permission flow for web.

@hannojg
Copy link
Contributor

hannojg commented Nov 19, 2024

yes, thats a false positive, sorry

Copy link
Contributor

🚀 Deployed to staging by https://github.com/Julesssss in version: 9.0.65-0 🚀

platform result
🤖 android 🤖 success ✅
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 success ✅
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 success ✅
🍎🔄 iOS HybridApp 🍎🔄 success ✅

Copy link
Contributor

🚀 Deployed to production by https://github.com/chiragsalian in version: 9.0.65-5 🚀

platform result
🤖 android 🤖 success ✅
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 success ✅
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 failure ❌
🍎🔄 iOS HybridApp 🍎🔄 failure ❌

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants