Description
Describe the bug
I am using the following report name + Cypress 9.4.1 (Yes old):
cypress/reports/mochawesome/mochawesome_[status]_[name]
In one of my suites, one test fails. The JSON top level stats for some reason bucket it as "others". Note it did not fail in a before hook:
"stats": {
"suites": 4,
"tests": 8,
"passes": 7,
"pending": 1,
"failures": 0,
"start": "2024-06-27T16:24:44.641Z",
"end": "2024-06-27T16:26:48.837Z",
"duration": 124196,
"testsRegistered": 9,
"passPercent": 87.5,
"pendingPercent": 11.11111111111111,
"other": 1,
"hasOther": true,
"skipped": 0,
"hasSkipped": false
}
Failure:
{
"title": "amazon s3 enable saving",
"fullTitle": "Destinations Accounts w/ records amazon s3 enable saving",
"timedOut": null,
"duration": 65368,
"state": "failed",
"speed": null,
"pass": false,
"fail": true,
"pending": false,
"context": "[\n \"/home/jenkins/workspace/form-platform-ui-client_PR-11259/cypress/screenshots/destinations/destination-accounts-spec.js/<Test name>\",\n \"/home/jenkins/workspace/form-platform-ui-client_PR-11259/cypress/node_modules/cypress-multi-reporters\"\n]",
"code": "...",
"diff": null
},
"uuid": "00030964-c122-4062-a652-f11e59ae58b2",
"parentUUID": "0a899bf8-80c8-47f5-bf4e-6a00768c20b3",
"isHook": false,
"skipped": false
The result filename is "mochawesome_pass_destination-accounts-spec.json"
Code Reproduce
This is a private repo and the issue does not reproduce often since the test is flakey...
Expected behavior
My expectation is if other > 0, filename should be fail and not pass.
Screenshots
If applicable, add screenshots to help explain your problem.
Environment (please complete the following information):
- Ubuntu
- mochawesome version - 6.2.0
- Cypress 9.4.1
- Node 20.9.0
Additional context
Add any other context about the problem here.
I can calculate the stats from the JSON, was just hoping to rely on the filename.