Skip to content

Adding workflow to run end to end tests #4230

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 7 commits into from
Oct 8, 2019
Merged

Conversation

jaiminpanchal27
Copy link
Collaborator

@jaiminpanchal27 jaiminpanchal27 commented Sep 25, 2019

Type of change

  • Feature

Description of change

This PR adds a new circleci job to run end to end tests every night on master branch. Job to run unit tests remains same. I have updated the config to use circleci workflow and aliases

Why run once every night ?

  • Our end to end tests are not very stable due to various reasons, problems with browserstack booting up browsers, connection failures in browserstack and no bid response in browserstack vm's.
  • Functional tests takes around 15 mins to run and hence it is not feasible as of now to run on every commit.

Please see https://circleci.com/gh/prebid/workflows/Prebid.js for past successful runs of both jobs.

@jaiminpanchal27 jaiminpanchal27 changed the title Adding workflow to run end to end tests WIP: Adding workflow to run end to end tests Sep 25, 2019
@jaiminpanchal27 jaiminpanchal27 changed the title WIP: Adding workflow to run end to end tests Adding workflow to run end to end tests Sep 30, 2019
Copy link
Collaborator

@jsnellbaker jsnellbaker left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@jaiminpanchal27 These changes look good overall. Had a question though on one point.


- &run_endtoend_test
name: BrowserStack End to end testing
command: echo "Running end to end test using workflows"
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you clarify how this command starts the e2e test process? I don't see the normal gulp e2e command in this file and this command appears to just print the noted text.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I used echo to verify workflow. Updated the command now

Jaimin Panchal added 2 commits October 7, 2019 15:06
@jsnellbaker jsnellbaker added needs 2nd review Core module updates require two approvals from the core team and removed question labels Oct 8, 2019
@Fawke
Copy link
Contributor

Fawke commented Oct 8, 2019

LGTM

@jaiminpanchal27 jaiminpanchal27 merged commit 3ee0d97 into master Oct 8, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
needs 2nd review Core module updates require two approvals from the core team
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants