Skip to content

Live tests: automate test runs against sandbox accounts. #42465

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
2 tasks
clnoll opened this issue Jul 23, 2024 · 0 comments · Fixed by #42577 or #42574
Closed
2 tasks

Live tests: automate test runs against sandbox accounts. #42465

clnoll opened this issue Jul 23, 2024 · 0 comments · Fixed by #42577 or #42574

Comments

@clnoll
Copy link
Contributor

clnoll commented Jul 23, 2024

Now that we've added connections to Cloud for our sandbox accounts, we can move forward with automating live tests.

Implementation

  • Add a list of connection IDs against which to test to each connector's metadata.yaml. These sandboxes should come from the integration-test-sandboxes workspace here. We can match up the source:connections using airbyte-api and automatically populate the metadata.yaml for the connector.
  • Update the GHA workflow for regression tests to add a pull request option. When regression tests are run in this context, they'll pass in the connection ID from a sandbox account.

Acceptance criteria

  • Live tests run automatically on PRs, against sandbox accounts only.
  • The outcome of the test run is visible in a status check.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment