Bitbucket-Server Sync fails on CE >= 9.9.0

[hauerhan]

Bug Description:

The repository sync with Bitbucket Server fails with the following error message (truncated in the logs):

"err":{"message":"Expected values which are `URL` or `undefined`. Received values of type `string`.","stack":"TypeError: Expected values which are `URL` or `undefined`. Received values of type `string`.\n    at Object.assertAny [as any] (file:///usr/src/mend/node_modules/@sindresorhus/is/distribution/index.js:838:15)\n    at Function.paginateEach [as paginate] (file:///usr/src/mend/node_modules/got/dist/source/create.js:142:24)\n    at paginateEach.next (<anonymous>)\n    at Si (file:///usr/src/mend/src/community.js:5:22741)\n    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)\n    at async Object.allInstallationsWithRepositories (file:///usr/src/mend/src/community.js:5:24353)\n    at async Ur (file:///usr/src/mend/src/community.js:1:43564)\n    at async file:///usr/src/mend/src/community.js:5:88071\n    at async file:///usr/src/mend...

This prevents new repositories from being added (and presumably old ones from being removed)

Details:

This occurs in Renovate CE starting with Version 9.9.0, including the latest 9.10.1.
It does not occur in CE 9.8.0 It does not occur in Renovate CLI versions used in those CE releases.
Tasks other than sycning (running jobs against existing onboarded repositories, opening PRs) do not seem to be affected.

We're using an older version of Bitbucket Server that might not be supported, but I'm not sure whether the error is due to API differences or occurs on more recent versions as well.

Bitbucket-related helm chart values:

mendRnvPlatform: "bitbucket-server"
mendRnvEndpoint: "https://<redacted-url-to-bitbucket>/"

I've also set ignorePrAuthor: true as a workaround for errors possibly related to API-differences. If someone can pinpoint which API call causes this error (or whether this is occurs during the response parsing instead of being related to the Renovate configuration e.g. missing values) I can check whether this might be version-related.

[hauerhan]

I've finally had some time to debug this issue further (up until and including Renovate CE 10.5.0), and I think it is related to paged responses from Bitbucket Server.
The response from GET /rest/api/1.0/repos contains a boolean isLastPage, and the error occurs if that value is true, i.e. if the amount of repositories exceeds the limit request parameter and response pagination occurs.

What I've tested:

I've set up a local Bitbucket Server instance using the official Atlassian Images of the appropriate Bitbucket version, with only one or two repositories created for testing purposes: No errors.

Using mitmproxy I've intercepted and modified the response of the actual Bitbucket Server:

• Original Response that causes the error:

{
    "size": 100,
    "limit": 100,
    "isLastPage": true,
    "values": [<removed>],
    "start": 0,
    "nextPageStart": 1462
}

• Modified response with only one value, with Error:

{
    "size": 1,
    "limit": 100,
    "isLastPage": false,
    "values": [
        {<removed>}
    ],
    "start": 0,
    "nextPageStart": 1462
}

• Modified response with only one value and isLastPage set to true, no Error:

{
    "size": 1,
    "limit": 100,
    "isLastPage": true,
    "values": [
        {<removed>}
    ],
    "start": 0,
    "nextPageStart": 1462
}

• Modified response with no values and isLastPage set to true, no Error:

{
    "size": 0,
    "limit": 100,
    "isLastPage": true,
    "values": [],
    "start": 0,
    "nextPageStart": 1462
}

• Modified response with no values and isLastPage set to false, with Error:

{
    "size": 0,
    "limit": 100,
    "isLastPage": false,
    "values": [],
    "start": 0,
    "nextPageStart": 1462
}

These test cases suggest that whenever Renovate CE >= 9.9.0 receives a response indicating that more repositories are available using "isLastPage": false, the app sync task on startup fails.

[atanev]

I'm also observing the error and opened a discussion at the renovatebot repository: renovatebot/renovate#37227

[atanev]

I'm also observing the error and opened a discussion at the renovatebot repository: renovatebot/renovate#37227

it appears that the issue might be related to community.js which isn't part of renovatebot.
I have tested running the renovatebot version 39.238.0 included in 9.9.0 and also the latest 39.264.0 and both are working fine.
Should that suggest the issue is in the mend buildup ontop of the cli?