Skip to content

Commit ea2ea60

Browse files
authored
Source clickup-api: Migrate to manifest-only (#44430)
1 parent 2ef1a5a commit ea2ea60

File tree

13 files changed

+10680
-3340
lines changed

13 files changed

+10680
-3340
lines changed
Original file line numberDiff line numberDiff line change
@@ -1,110 +1,65 @@
1-
# Clickup-Api source connector
1+
# Clickup API source connector
22

3+
This directory contains the manifest-only connector for `source-clickup-api`.
4+
This _manifest-only_ connector is not a Python package on its own, as it runs inside of the base `source-declarative-manifest` image.
35

4-
This is the repository for the Clickup Api configuration based source connector.
5-
For information about how to use this connector within Airbyte, see [the documentation](https://docs.airbyte.com/integrations/sources/clickup-api).
6+
For information about how to configure and use this connector within Airbyte, see [the connector's full documentation](https://docs.airbyte.com/integrations/sources/clickup-api).
67

78
## Local development
89

9-
### Prerequisites
10+
We recommend using the Connector Builder to edit this connector.
11+
Using either Airbyte Cloud or your local Airbyte OSS instance, navigate to the **Builder** tab and select **Import a YAML**.
12+
Then select the connector's `manifest.yaml` file to load the connector into the Builder. You're now ready to make changes to the connector!
1013

11-
* Python (`^3.9`)
12-
* Poetry (`^1.7`) - installation instructions [here](https://python-poetry.org/docs/#installation)
14+
If you prefer to develop locally, you can follow the instructions below.
1315

16+
### Building the docker image
1417

18+
You can build any manifest-only connector with `airbyte-ci`:
1519

16-
### Installing the connector
20+
1. Install [`airbyte-ci`](https://github.com/airbytehq/airbyte/blob/master/airbyte-ci/connectors/pipelines/README.md)
21+
2. Run the following command to build the docker image:
1722

18-
From this connector directory, run:
1923
```bash
20-
poetry install --with dev
24+
airbyte-ci connectors --name=source-clickup-api build
2125
```
2226

27+
An image will be available on your host with the tag `airbyte/source-clickup-api:dev`.
2328

24-
### Create credentials
29+
### Creating credentials
2530

2631
**If you are a community contributor**, follow the instructions in the [documentation](https://docs.airbyte.com/integrations/sources/clickup-api)
27-
to generate the necessary credentials. Then create a file `secrets/config.json` conforming to the `spec` inside `source_clickup_api/manifest.yaml` file.
32+
to generate the necessary credentials. Then create a file `secrets/config.json` conforming to the `spec` object in the connector's `manifest.yaml` file.
2833
Note that any directory named `secrets` is gitignored across the entire Airbyte repo, so there is no danger of accidentally checking in sensitive information.
29-
See `integration_tests/sample_config.json` for a sample config file.
30-
31-
32-
### Locally running the connector
33-
34-
```
35-
poetry run source-clickup-api spec
36-
poetry run source-clickup-api check --config secrets/config.json
37-
poetry run source-clickup-api discover --config secrets/config.json
38-
poetry run source-clickup-api read --config secrets/config.json --catalog integration_tests/configured_catalog.json
39-
```
4034

41-
### Running tests
35+
### Running as a docker container
4236

43-
To run tests locally, from the connector directory run:
37+
Then run any of the standard source connector commands:
4438

45-
```
46-
poetry run pytest tests
47-
```
48-
49-
### Building the docker image
50-
51-
1. Install [`airbyte-ci`](https://github.com/airbytehq/airbyte/blob/master/airbyte-ci/connectors/pipelines/README.md)
52-
2. Run the following command to build the docker image:
5339
```bash
54-
airbyte-ci connectors --name=source-clickup-api build
55-
```
56-
57-
An image will be available on your host with the tag `airbyte/source-clickup-api:dev`.
58-
An image will be available on your host with the tag `airbyte/source-clickup-api:dev`.
59-
60-
61-
### Running as a docker container
62-
63-
Then run any of the connector commands as follows:
64-
```
6540
docker run --rm airbyte/source-clickup-api:dev spec
6641
docker run --rm -v $(pwd)/secrets:/secrets airbyte/source-clickup-api:dev check --config /secrets/config.json
6742
docker run --rm -v $(pwd)/secrets:/secrets airbyte/source-clickup-api:dev discover --config /secrets/config.json
6843
docker run --rm -v $(pwd)/secrets:/secrets -v $(pwd)/integration_tests:/integration_tests airbyte/source-clickup-api:dev read --config /secrets/config.json --catalog /integration_tests/configured_catalog.json
6944
```
7045

71-
### Running our CI test suite
46+
### Running the CI test suite
7247

7348
You can run our full test suite locally using [`airbyte-ci`](https://github.com/airbytehq/airbyte/blob/master/airbyte-ci/connectors/pipelines/README.md):
74-
```bash
75-
airbyte-ci connectors --name=source-clickup-api test
76-
```
77-
78-
### Customizing acceptance Tests
79-
80-
Customize `acceptance-test-config.yml` file to configure acceptance tests. See [Connector Acceptance Tests](https://docs.airbyte.com/connector-development/testing-connectors/connector-acceptance-tests-reference) for more information.
81-
If your connector requires to create or destroy resources for use during acceptance tests create fixtures for it and place them inside integration_tests/acceptance.py.
82-
83-
### Dependency Management
8449

85-
All of your dependencies should be managed via Poetry.
86-
To add a new dependency, run:
8750
```bash
88-
poetry add <package-name>
51+
airbyte-ci connectors --name=source-clickup-api test
8952
```
9053

91-
Please commit the changes to `pyproject.toml` and `poetry.lock` files.
92-
9354
## Publishing a new version of the connector
9455

95-
You've checked out the repo, implemented a million dollar feature, and you're ready to share your changes with the world. Now what?
96-
1. Make sure your changes are passing our test suite: `airbyte-ci connectors --name=source-clickup-api test`
97-
2. Bump the connector version (please follow [semantic versioning for connectors](https://docs.airbyte.com/contributing-to-airbyte/resources/pull-requests-handbook/#semantic-versioning-for-connectors)):
56+
If you want to contribute changes to `source-clickup-api`, here's how you can do that:
57+
1. Make your changes locally, or load the connector's manifest into Connector Builder and make changes there.
58+
2. Make sure your changes are passing our test suite with `airbyte-ci connectors --name=source-clickup-api test`
59+
3. Bump the connector version (please follow [semantic versioning for connectors](https://docs.airbyte.com/contributing-to-airbyte/resources/pull-requests-handbook/#semantic-versioning-for-connectors)):
9860
- bump the `dockerImageTag` value in in `metadata.yaml`
99-
- bump the `version` value in `pyproject.toml`
100-
2. Bump the connector version (please follow [semantic versioning for connectors](https://docs.airbyte.com/contributing-to-airbyte/resources/pull-requests-handbook/#semantic-versioning-for-connectors)):
101-
- bump the `dockerImageTag` value in in `metadata.yaml`
102-
- bump the `version` value in `pyproject.toml`
103-
3. Make sure the `metadata.yaml` content is up to date.
104-
4. Make sure the connector documentation and its changelog is up to date (`docs/integrations/sources/clickup-api.md`).
10561
4. Make sure the connector documentation and its changelog is up to date (`docs/integrations/sources/clickup-api.md`).
10662
5. Create a Pull Request: use [our PR naming conventions](https://docs.airbyte.com/contributing-to-airbyte/resources/pull-requests-handbook/#pull-request-title-convention).
10763
6. Pat yourself on the back for being an awesome contributor.
10864
7. Someone from Airbyte will take a look at your PR and iterate with you to merge it into master.
10965
8. Once your PR is merged, the new version of the connector will be automatically published to Docker Hub and our connector registry.
110-
8. Once your PR is merged, the new version of the connector will be automatically published to Docker Hub and our connector registry.

airbyte-integrations/connectors/source-clickup-api/__init__.py

-3
This file was deleted.

airbyte-integrations/connectors/source-clickup-api/acceptance-test-config.yml

+1-1
Original file line numberDiff line numberDiff line change
@@ -28,7 +28,7 @@ acceptance_tests:
2828
bypass_reason: ignore changing value in full_refresh of acceptance-tests
2929
spec:
3030
tests:
31-
- spec_path: source_clickup_api/spec.yaml
31+
- spec_path: manifest.yaml
3232
timeout_seconds: 1200
3333
backward_compatibility_tests_config:
3434
disable_for_version: 0.1.12 # All the parent Ids are now taken from responses itself

airbyte-integrations/connectors/source-clickup-api/main.py

-8
This file was deleted.

0 commit comments

Comments
 (0)