|
1 | 1 | # Workable source connector
|
2 | 2 |
|
| 3 | +This directory contains the manifest-only connector for `source-workable`. |
| 4 | +This _manifest-only_ connector is not a Python package on its own, as it runs inside of the base `source-declarative-manifest` image. |
3 | 5 |
|
4 |
| -This is the repository for the Workable configuration based source connector. |
5 |
| -For information about how to use this connector within Airbyte, see [the documentation](https://docs.airbyte.com/integrations/sources/workable). |
| 6 | +For information about how to configure and use this connector within Airbyte, see [the connector's full documentation](https://docs.airbyte.com/integrations/sources/workable). |
6 | 7 |
|
7 | 8 | ## Local development
|
8 | 9 |
|
9 |
| -### Prerequisites |
| 10 | +We recommend using the Connector Builder to edit this connector. |
| 11 | +Using either Airbyte Cloud or your local Airbyte OSS instance, navigate to the **Builder** tab and select **Import a YAML**. |
| 12 | +Then select the connector's `manifest.yaml` file to load the connector into the Builder. You're now ready to make changes to the connector! |
10 | 13 |
|
11 |
| -* Python (`^3.9`) |
12 |
| -* Poetry (`^1.7`) - installation instructions [here](https://python-poetry.org/docs/#installation) |
| 14 | +If you prefer to develop locally, you can follow the instructions below. |
13 | 15 |
|
| 16 | +### Building the docker image |
14 | 17 |
|
| 18 | +You can build any manifest-only connector with `airbyte-ci`: |
15 | 19 |
|
16 |
| -### Installing the connector |
| 20 | +1. Install [`airbyte-ci`](https://github.com/airbytehq/airbyte/blob/master/airbyte-ci/connectors/pipelines/README.md) |
| 21 | +2. Run the following command to build the docker image: |
17 | 22 |
|
18 |
| -From this connector directory, run: |
19 | 23 | ```bash
|
20 |
| -poetry install --with dev |
| 24 | +airbyte-ci connectors --name=source-workable build |
21 | 25 | ```
|
22 | 26 |
|
| 27 | +An image will be available on your host with the tag `airbyte/source-workable:dev`. |
23 | 28 |
|
24 |
| -### Create credentials |
| 29 | +### Creating credentials |
25 | 30 |
|
26 | 31 | **If you are a community contributor**, follow the instructions in the [documentation](https://docs.airbyte.com/integrations/sources/workable)
|
27 |
| -to generate the necessary credentials. Then create a file `secrets/config.json` conforming to the spec inside `source_workable/manifest.yaml` file. |
| 32 | +to generate the necessary credentials. Then create a file `secrets/config.json` conforming to the `spec` object in the connector's `manifest.yaml` file. |
28 | 33 | Note that any directory named `secrets` is gitignored across the entire Airbyte repo, so there is no danger of accidentally checking in sensitive information.
|
29 |
| -See `sample_files/sample_config.json` for a sample config file. |
30 |
| - |
31 |
| - |
32 |
| -### Locally running the connector |
33 |
| - |
34 |
| -``` |
35 |
| -poetry run source-workable spec |
36 |
| -poetry run source-workable check --config secrets/config.json |
37 |
| -poetry run source-workable discover --config secrets/config.json |
38 |
| -poetry run source-workable read --config secrets/config.json --catalog integration_tests/configured_catalog.json |
39 |
| -``` |
40 | 34 |
|
41 |
| -### Running tests |
| 35 | +### Running as a docker container |
42 | 36 |
|
43 |
| -To run tests locally, from the connector directory run: |
| 37 | +Then run any of the standard source connector commands: |
44 | 38 |
|
45 |
| -``` |
46 |
| -poetry run pytest tests |
47 |
| -``` |
48 |
| - |
49 |
| -### Building the docker image |
50 |
| - |
51 |
| -1. Install [`airbyte-ci`](https://github.com/airbytehq/airbyte/blob/master/airbyte-ci/connectors/pipelines/README.md) |
52 |
| -2. Run the following command to build the docker image: |
53 | 39 | ```bash
|
54 |
| -airbyte-ci connectors --name=source-workable build |
55 |
| -``` |
56 |
| - |
57 |
| -An image will be available on your host with the tag `airbyte/source-workable:dev`. |
58 |
| -An image will be available on your host with the tag `airbyte/source-workable:dev`. |
59 |
| - |
60 |
| - |
61 |
| -### Running as a docker container |
62 |
| - |
63 |
| -Then run any of the connector commands as follows: |
64 |
| -``` |
65 | 40 | docker run --rm airbyte/source-workable:dev spec
|
66 | 41 | docker run --rm -v $(pwd)/secrets:/secrets airbyte/source-workable:dev check --config /secrets/config.json
|
67 | 42 | docker run --rm -v $(pwd)/secrets:/secrets airbyte/source-workable:dev discover --config /secrets/config.json
|
68 | 43 | docker run --rm -v $(pwd)/secrets:/secrets -v $(pwd)/integration_tests:/integration_tests airbyte/source-workable:dev read --config /secrets/config.json --catalog /integration_tests/configured_catalog.json
|
69 | 44 | ```
|
70 | 45 |
|
71 |
| -### Running our CI test suite |
| 46 | +### Running the CI test suite |
72 | 47 |
|
73 | 48 | You can run our full test suite locally using [`airbyte-ci`](https://github.com/airbytehq/airbyte/blob/master/airbyte-ci/connectors/pipelines/README.md):
|
74 |
| -```bash |
75 |
| -airbyte-ci connectors --name=source-workable test |
76 |
| -``` |
77 |
| - |
78 |
| -### Customizing acceptance Tests |
79 |
| - |
80 |
| -Customize `acceptance-test-config.yml` file to configure acceptance tests. See [Connector Acceptance Tests](https://docs.airbyte.com/connector-development/testing-connectors/connector-acceptance-tests-reference) for more information. |
81 |
| -If your connector requires to create or destroy resources for use during acceptance tests create fixtures for it and place them inside integration_tests/acceptance.py. |
82 |
| - |
83 |
| -### Dependency Management |
84 | 49 |
|
85 |
| -All of your dependencies should be managed via Poetry. |
86 |
| -To add a new dependency, run: |
87 | 50 | ```bash
|
88 |
| -poetry add <package-name> |
| 51 | +airbyte-ci connectors --name=source-workable test |
89 | 52 | ```
|
90 | 53 |
|
91 |
| -Please commit the changes to `pyproject.toml` and `poetry.lock` files. |
92 |
| - |
93 | 54 | ## Publishing a new version of the connector
|
94 | 55 |
|
95 |
| -You've checked out the repo, implemented a million dollar feature, and you're ready to share your changes with the world. Now what? |
96 |
| -1. Make sure your changes are passing our test suite: `airbyte-ci connectors --name=source-workable test` |
97 |
| -2. Bump the connector version (please follow [semantic versioning for connectors](https://docs.airbyte.com/contributing-to-airbyte/resources/pull-requests-handbook/#semantic-versioning-for-connectors)): |
| 56 | +If you want to contribute changes to `source-workable`, here's how you can do that: |
| 57 | +1. Make your changes locally, or load the connector's manifest into Connector Builder and make changes there. |
| 58 | +2. Make sure your changes are passing our test suite with `airbyte-ci connectors --name=source-workable test` |
| 59 | +3. Bump the connector version (please follow [semantic versioning for connectors](https://docs.airbyte.com/contributing-to-airbyte/resources/pull-requests-handbook/#semantic-versioning-for-connectors)): |
98 | 60 | - bump the `dockerImageTag` value in in `metadata.yaml`
|
99 |
| - - bump the `version` value in `pyproject.toml` |
100 |
| -2. Bump the connector version (please follow [semantic versioning for connectors](https://docs.airbyte.com/contributing-to-airbyte/resources/pull-requests-handbook/#semantic-versioning-for-connectors)): |
101 |
| - - bump the `dockerImageTag` value in in `metadata.yaml` |
102 |
| - - bump the `version` value in `pyproject.toml` |
103 |
| -3. Make sure the `metadata.yaml` content is up to date. |
104 |
| -4. Make sure the connector documentation and its changelog is up to date (`docs/integrations/sources/workable.md`). |
105 | 61 | 4. Make sure the connector documentation and its changelog is up to date (`docs/integrations/sources/workable.md`).
|
106 | 62 | 5. Create a Pull Request: use [our PR naming conventions](https://docs.airbyte.com/contributing-to-airbyte/resources/pull-requests-handbook/#pull-request-title-convention).
|
107 | 63 | 6. Pat yourself on the back for being an awesome contributor.
|
108 | 64 | 7. Someone from Airbyte will take a look at your PR and iterate with you to merge it into master.
|
109 |
| -8. Once your PR is merged, the new version of the connector will be automatically published to Docker Hub and our connector registry. |
110 | 65 | 8. Once your PR is merged, the new version of the connector will be automatically published to Docker Hub and our connector registry.
|
0 commit comments