Skip to content

Commit 8fe89f5

Browse files
midavadimoctavia-squidington-iii
midavadim
and
octavia-squidington-iii
authored
🎉 Source SurveyMonkey - to beta (#14998)
* fixed incremental syns for response stream, added unittest, fixed specs, fixed incremental SAT * removed comments * updated docs * updated docs * bumped connector version * bumped release stage * auto-bump connector version [ci skip] * updated source_specs.yaml Co-authored-by: Octavia Squidington III <[email protected]>
1 parent e2526ff commit 8fe89f5

File tree

18 files changed

+768
-183
lines changed

18 files changed

+768
-183
lines changed

‎airbyte-config/init/src/main/resources/seed/source_definitions.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -945,11 +945,11 @@
945945
- name: SurveyMonkey
946946
sourceDefinitionId: badc5925-0485-42be-8caa-b34096cb71b5
947947
dockerRepository: airbyte/source-surveymonkey
948-
dockerImageTag: 0.1.8
948+
dockerImageTag: 0.1.9
949949
documentationUrl: https://docs.airbyte.io/integrations/sources/surveymonkey
950950
icon: surveymonkey.svg
951951
sourceType: api
952-
releaseStage: alpha
952+
releaseStage: beta
953953
- name: TalkDesk Explore
954954
sourceDefinitionId: f00d2cf4-3c28-499a-ba93-b50b6f26359e
955955
dockerRepository: airbyte/source-talkdesk-explore

‎airbyte-config/init/src/main/resources/seed/source_specs.yaml

Lines changed: 12 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -9367,34 +9367,38 @@
93679367
supportsNormalization: false
93689368
supportsDBT: false
93699369
supported_destination_sync_modes: []
9370-
- dockerImage: "airbyte/source-surveymonkey:0.1.8"
9370+
- dockerImage: "airbyte/source-surveymonkey:0.1.9"
93719371
spec:
93729372
documentationUrl: "https://docs.airbyte.io/integrations/sources/surveymonkey"
93739373
connectionSpecification:
93749374
$schema: "http://json-schema.org/draft-07/schema#"
93759375
title: "SurveyMonkey Spec"
93769376
type: "object"
93779377
required:
9378+
- "access_token"
93789379
- "start_date"
93799380
additionalProperties: true
93809381
properties:
9382+
access_token:
9383+
title: "Access Token"
9384+
order: 0
9385+
type: "string"
9386+
airbyte_secret: true
9387+
description: "Access Token for making authenticated requests. See the <a\
9388+
\ href=\"https://docs.airbyte.io/integrations/sources/surveymonkey\">docs</a>\
9389+
\ for information on how to generate this key."
93819390
start_date:
93829391
title: "Start Date"
9392+
order: 1
93839393
type: "string"
93849394
description: "UTC date and time in the format 2017-01-25T00:00:00Z. Any\
93859395
\ data before this date will not be replicated."
93869396
pattern: "^[0-9]{4}-[0-9]{2}-[0-9]{2}T[0-9]{2}:[0-9]{2}:[0-9]{2}Z?$"
93879397
examples:
93889398
- "2021-01-01T00:00:00Z"
9389-
access_token:
9390-
title: "Access Token"
9391-
type: "string"
9392-
airbyte_secret: true
9393-
description: "Access Token for making authenticated requests. See the <a\
9394-
\ href=\"https://docs.airbyte.io/integrations/sources/surveymonkey\">docs</a>\
9395-
\ for information on how to generate this key."
93969399
survey_ids:
93979400
type: "array"
9401+
order: 2
93989402
items:
93999403
type: "string"
94009404
pattern: "^[0-9]{8,9}$"

‎airbyte-integrations/connectors/source-surveymonkey/Dockerfile

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -12,5 +12,5 @@ RUN pip install .
1212
ENV AIRBYTE_ENTRYPOINT "python /airbyte/integration_code/main.py"
1313
ENTRYPOINT ["python", "/airbyte/integration_code/main.py"]
1414

15-
LABEL io.airbyte.version=0.1.8
15+
LABEL io.airbyte.version=0.1.9
1616
LABEL io.airbyte.name=airbyte/source-surveymonkey

‎airbyte-integrations/connectors/source-surveymonkey/acceptance-test-config.yml

Lines changed: 3 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -12,13 +12,9 @@ tests:
1212
basic_read:
1313
- config_path: "secrets/config.json"
1414
configured_catalog_path: "integration_tests/configured_catalog.json"
15-
# We cannot use these tests for testing Incremental,
16-
# since for Surveymonkey the State is saved for each Survey separately,
17-
# and the Acceptance Tests at this stage do not support this functionality.
18-
#incremental:
19-
# - config_path: "secrets/config.json"
20-
# configured_catalog_path: "integration_tests/configured_catalog.json"
21-
# future_state_path: "integration_tests/abnormal_state.json"
15+
incremental:
16+
- config_path: "secrets/config.json"
17+
configured_catalog_path: "integration_tests/configured_catalog.json"
2218
full_refresh:
2319
- config_path: "secrets/config.json"
2420
configured_catalog_path: "integration_tests/configured_catalog.json"

‎airbyte-integrations/connectors/source-surveymonkey/integration_tests/abnormal_state.json

Lines changed: 46 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,46 @@
1+
{
2+
"surveys": {
3+
"date_modified": "2022-06-10T11:02:01"
4+
},
5+
"survey_responses": {
6+
"306079584": {
7+
"date_modified": "2022-06-08T18:17:18+00:00"
8+
},
9+
"307785429": {
10+
"date_modified": "2022-06-10T10:59:43+00:00"
11+
},
12+
"307785444": {
13+
"date_modified": "2022-06-10T11:00:19+00:00"
14+
},
15+
"307785394": {
16+
"date_modified": "2022-06-10T11:00:59+00:00"
17+
},
18+
"307785402": {
19+
"date_modified": "2022-06-10T11:01:31+00:00"
20+
},
21+
"307785408": {
22+
"date_modified": "2022-06-10T11:02:08+00:00"
23+
},
24+
"307785448": {
25+
"date_modified": "2022-06-10T11:02:49+00:00"
26+
},
27+
"307784834": {
28+
"date_modified": "2022-06-10T11:03:45+00:00"
29+
},
30+
"307784863": {
31+
"date_modified": "2022-06-10T11:04:29+00:00"
32+
},
33+
"307784846": {
34+
"date_modified": "2022-06-10T11:05:05+00:00"
35+
},
36+
"307784856": {
37+
"date_modified": "2022-06-10T11:05:44+00:00"
38+
},
39+
"307785388": {
40+
"date_modified": "2022-06-10T11:06:20+00:00"
41+
},
42+
"307785415": {
43+
"date_modified": "2022-06-10T11:06:43+00:00"
44+
}
45+
}
46+
}

‎airbyte-integrations/connectors/source-surveymonkey/integration_tests/survey_ids.json

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,13 @@
1+
{
2+
"streams": [
3+
{
4+
"stream": {
5+
"name": "survey_ids",
6+
"json_schema": {},
7+
"supported_sync_modes": ["full_refresh"]
8+
},
9+
"sync_mode": "full_refresh",
10+
"destination_sync_mode": "append"
11+
}
12+
]
13+
}

‎airbyte-integrations/connectors/source-surveymonkey/integration_tests/survey_pages.json

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,16 @@
1+
{
2+
"streams": [
3+
{
4+
"stream": {
5+
"name": "survey_pages",
6+
"json_schema": {},
7+
"supported_sync_modes": ["full_refresh", "incremental"],
8+
"source_defined_cursor": true,
9+
"default_cursor_field": ["date_modified"]
10+
},
11+
"sync_mode": "full_refresh",
12+
"cursor_field": ["date_modified"],
13+
"destination_sync_mode": "append"
14+
}
15+
]
16+
}

‎airbyte-integrations/connectors/source-surveymonkey/integration_tests/survey_questions.json

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,16 @@
1+
{
2+
"streams": [
3+
{
4+
"stream": {
5+
"name": "survey_questions",
6+
"json_schema": {},
7+
"supported_sync_modes": ["full_refresh", "incremental"],
8+
"source_defined_cursor": true,
9+
"default_cursor_field": ["date_modified"]
10+
},
11+
"sync_mode": "full_refresh",
12+
"cursor_field": ["date_modified"],
13+
"destination_sync_mode": "append"
14+
}
15+
]
16+
}

‎airbyte-integrations/connectors/source-surveymonkey/integration_tests/survey_responses.json

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,16 @@
1+
{
2+
"streams": [
3+
{
4+
"stream": {
5+
"name": "survey_responses",
6+
"json_schema": {},
7+
"supported_sync_modes": ["full_refresh", "incremental"],
8+
"source_defined_cursor": true,
9+
"default_cursor_field": ["date_modified"]
10+
},
11+
"sync_mode": "incremental",
12+
"cursor_field": ["date_modified"],
13+
"destination_sync_mode": "append"
14+
}
15+
]
16+
}

‎airbyte-integrations/connectors/source-surveymonkey/integration_tests/surveys.json

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,16 @@
1+
{
2+
"streams": [
3+
{
4+
"stream": {
5+
"name": "surveys",
6+
"json_schema": {},
7+
"supported_sync_modes": ["full_refresh", "incremental"],
8+
"source_defined_cursor": true,
9+
"default_cursor_field": ["date_modified"]
10+
},
11+
"sync_mode": "incremental",
12+
"cursor_field": ["date_modified"],
13+
"destination_sync_mode": "append"
14+
}
15+
]
16+
}

0 commit comments

Comments
 (0)