-
Notifications
You must be signed in to change notification settings - Fork 4.6k
Stop publishing java connectors on merge to master #28344
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Before Merging a Connector Pull RequestWow! What a great pull request you have here! 🎉 To merge this PR, ensure the following has been done/considered for each connector added or updated:
If the checklist is complete, but the CI check is failing,
|
if modified: | ||
selected_connectors_and_files = modified_connectors_and_files |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Moved this to be before the other filters so they can be applied together
if ctx.obj["modified"]: | ||
selected_connectors_and_files = get_modified_connectors(get_modified_metadata_files(ctx.obj["modified_files"])) | ||
selected_connectors_names = [connector.technical_name for connector in selected_connectors_and_files.keys()] |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Modified connectors were already being filtered out in the previous step, so the selected_connectors_and_files
ctx already does this.
This was overwriting the other filters in the publish step
@@ -39,7 +39,7 @@ jobs: | |||
metadata_service_gcs_credentials: ${{ secrets.METADATA_SERVICE_PROD_GCS_CREDENTIALS }} | |||
slack_webhook_url: ${{ secrets.PUBLISH_ON_MERGE_SLACK_WEBHOOK }} | |||
spec_cache_gcs_credentials: ${{ secrets.SPEC_CACHE_SERVICE_ACCOUNT_KEY_PUBLISH }} | |||
subcommand: "connectors --concurrency=1 --execute-timeout=3600 --modified publish --main-release" | |||
subcommand: "connectors --concurrency=1 --execute-timeout=3600 --modified --language=python --language=low-code publish --main-release" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Skip java connectors by specifying we only want python and low-code connectors
Coverage report for source-postgres
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Great use of the language flag!
* process language after modified flag * modify some connectors * empty commit * another bump * modified connectors are already filtered * change some connectors * change some connectors again * revert to master version * nit * filter for python/lowcode connectors
What
Changes our "publish on merge" workfow to ignore java connectors
Example run with languages specified for change on faker + postgres (
--modified --language=python
):https://github.com/airbytehq/airbyte/actions/runs/5559625325/jobs/10155926192#step:5:535
Example run with no languages specified for change on faker + postgres (
--modified
)https://github.com/airbytehq/airbyte/actions/runs/5559622521/jobs/10155920377#step:5:532
How
--modified
argpython
andlow-code
languages so java is excluded.