-
Notifications
You must be signed in to change notification settings - Fork 0
Canary Automated Testing #471
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from 18 commits
Commits
Show all changes
116 commits
Select commit
Hold shift + click to select a range
d8cab8f
Add a workflow to test and publish releases
chewy-zlai 6af9e09
Update version of setup-python action
chewy-zlai 1e21aa5
Add id-token:write permission
chewy-zlai 6314ce2
Remove unnecessary gcp credentials from build artifacts job
chewy-zlai 4de2174
Use Major.Minor.Patch for test version
chewy-zlai ec9ac6e
Fix env variable setting
chewy-zlai 171dac2
Set version to 0.0.0 for testing
chewy-zlai 06881e0
Add Bazel cache credentials, and add failure hanlding to both integra…
chewy-zlai e725aa7
Pass in ssh key to checkout action. Also add dependency on both integ…
chewy-zlai 1fa9f2d
Add version back to python wheel name
chewy-zlai 9d37543
Add id-token permissions to integration test jobs
chewy-zlai 86ef8d8
fix name of aws role to assume
chewy-zlai 5321830
Rename github-actions
chewy-zlai a80796d
fix service account names
chewy-zlai ad2275f
activate venv to find zipline command
chewy-zlai b80e698
Fix python path
chewy-zlai 5eaee89
remove gcp submitter jar as it is not needed anymore.
chewy-zlai 4af4c33
Add test of compile to aws integration tests
chewy-zlai 9d0e80f
fix gcp region env variable
chewy-zlai 9b8e625
cleaned some whitespace
chewy-zlai d2e4d53
cleaned some more whitespace
chewy-zlai aa34249
run fetch command on its own to see if it gives an error message
chewy-zlai 8873a14
Merge branch 'main' of https://github.com/zipline-ai/chronon into che…
chewy-zlai df72a92
Merge branch 'main' of https://github.com/zipline-ai/chronon into che…
chewy-zlai d5092ba
fix typo
chewy-zlai 7ddcc4c
define green to fix the info bars
chewy-zlai 0d02a31
Fix references to env.Version. Also fix arn for AWS credentials
chewy-zlai 15ce246
fix missed reference to Version
chewy-zlai 70a17a7
rename references to jars
chewy-zlai 38aa6ae
fix aws customer names
chewy-zlai 4acb554
remove ls
chewy-zlai cf5fa58
remove base for now
chewy-zlai 7a0d7a2
Readd base back in
chewy-zlai 941bffd
Add pushing artifacts to dev
chewy-zlai 60f5382
Remove pushing to plaid as their infra isn't setup yet
chewy-zlai 345c0ba
Done testing. Trigger on published release now
chewy-zlai 5c0e9c2
Edit devnotes to include instructions for publishing a new release
chewy-zlai b216c2a
Remove TODO for setting the version
chewy-zlai 4596836
Merge branch 'main' of https://github.com/zipline-ai/chronon into che…
chewy-zlai 6b2374d
Update to python 3.11 for building the wheel to match .tool-versions,…
chewy-zlai e6f3084
Try splitting out push_to_canary into separate jobs.
chewy-zlai 1dc3150
Fix names of wheel and jars
chewy-zlai c034901
Checkout the repo for new jobs
chewy-zlai e39cc58
Stop pushing quickstart image to canary and start pushing jars
chewy-zlai c031aee
remove empty env from step
chewy-zlai 31efee7
switch service account to github_actions
chewy-zlai 650a4e4
testing passed. Run on pushes to main
chewy-zlai 098d1e7
Delete artifacts after publishing to reduce storage costs
chewy-zlai 6acabb3
Set version to 0.0.0 for testing
chewy-zlai 4f84228
Done testing. Use version from release again
chewy-zlai f9aa2fa
Test pushing to plaid
chewy-zlai 0c787fc
Add python wheel to canary push
chewy-zlai 170e40d
Test version with 'v' prefix
chewy-zlai 1a12024
Test python version
chewy-zlai 638b771
Handle release version tags which start with 'v'
chewy-zlai 302edbc
Ignore 'v' prefix on tags
chewy-zlai 2f6e228
Fix ignoring 'v' prefix on tags
chewy-zlai 7f9f494
Fix reference to env variable
chewy-zlai 35fd8d2
Handle v in version
chewy-zlai 3a709ee
Fetch tags
chewy-zlai ab350a4
Done testing release workflow
chewy-zlai d88c705
Use 'git tag' instead of 'git describe'
chewy-zlai e48baa6
Pass wheel file name as an output between jobs
chewy-zlai af2565d
Use renamed branches
chewy-zlai e3642ce
Merge branch 'main' of https://github.com/zipline-ai/chronon into che…
chewy-zlai 6b0c355
add aws testing
chewy-zlai ea6e000
Change wheels to wheel. Add metadata
chewy-zlai 084dfc7
update metadata for gcs
chewy-zlai 82d86ab
update metadata for gcs and ignore errors deleting glue table
chewy-zlai 7ffd48e
Ignore errors deleting s3 tables. Separate metadata update from pushi…
chewy-zlai 1e00a22
use '|| true' to ignore failures when deleting s3 objects and glue ta…
chewy-zlai dfb2dc0
Add CUSTOMER_ID=canary
chewy-zlai 57b965c
Push to Canary works now. Setting to push to main
chewy-zlai 53fad09
Add VERSION as a env variable
chewy-zlai 13712c2
Restructure to push jars before testing
chewy-zlai 41b020e
move integration testing logic to push_to_canary and have publish_rel…
chewy-zlai 880137f
rename CANARY_CONFS_SSH_KEY secret and clean up python wheel at end o…
chewy-zlai 552059e
remove empty env
chewy-zlai a440715
Fix wheel references
chewy-zlai b879b0d
add GH_TOKEN env variable for github actions
chewy-zlai 24cab40
Fix reference to wheel_file, and narrow permissions
chewy-zlai aadf632
Add actions: read permission
chewy-zlai ef94244
Merge branch 'main' of https://github.com/zipline-ai/chronon into che…
chewy-zlai 244b18c
Add GH_TOKEN to step converting release to draft
chewy-zlai 1c6be4d
Separate canary testing PR from release publishing PR
chewy-zlai 0740b66
Merge branch 'main' of https://github.com/zipline-ai/chronon into che…
chewy-zlai 544c039
Move artifact deletion to after the tests. Also add info to failure S…
chewy-zlai 115a08c
Use 'version' parameter and refactor some of the test code into a fun…
chewy-zlai f824b34
Merge branch 'main' of https://github.com/zipline-ai/chronon into che…
chewy-zlai 755ac3c
Merge branch 'main' of https://github.com/zipline-ai/chronon into che…
chewy-zlai b5f1e5c
Fail on dataproc error
chewy-zlai 55fc27d
Extract state string
chewy-zlai 23d374d
Give write permissions to job which pushes to main-passing-tests
chewy-zlai fb59b21
testing passed. Run on pushes to main
chewy-zlai 5f9da00
Clean up whitespace
chewy-zlai 936e793
Remove more whitespace
chewy-zlai 8f7800e
Cancel running spark jobs if the workflow is cancelled
chewy-zlai 124f517
use if: cancelled()
chewy-zlai 99c99c8
remove unneeded download steps
chewy-zlai 19e3753
remove whitespace
chewy-zlai ab03d02
add id to workflow step to reference job_id output
chewy-zlai 8c85421
Use correct gcloud command
chewy-zlai d7ba819
add region to command to kill spark job
chewy-zlai 34d5aaa
quiet flag and ignore errors
chewy-zlai 2047218
cancelling the job worked. Setting it to pushs on main again
chewy-zlai 4486afc
Move table deletion into the same step as the tests
chewy-zlai 1d8bf87
Merge branch 'main' of https://github.com/zipline-ai/chronon into che…
chewy-zlai 184e7bf
Use existing scripts to run integration tests
chewy-zlai 933a52f
Merge branch 'main' of https://github.com/zipline-ai/chronon into che…
chewy-zlai 6c8bb1e
fix aws group_bys team, and setup gcloud
chewy-zlai 68bea64
Passing tests. push on main
chewy-zlai 0c23800
Review edits
chewy-zlai 8d3fee3
Add sha to wheel version. Use quickstart for both dev and canary unti…
chewy-zlai 177f9bf
Merge branch 'main' of https://github.com/zipline-ai/chronon into che…
chewy-zlai f814e62
One last test before I merge
chewy-zlai 151064b
Done testing
chewy-zlai File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.