1
- # Elasticsearch Source
1
+ # Elasticsearch
2
2
3
- ## Features
3
+ This page contains the setup guide and reference information for the Elasticsearch source connector.
4
4
5
- | Feature | Supported?\( Yes/No\) | Notes |
6
- | :--- | :--- | :--- |
7
- | Full Refresh Sync | Yes | |
8
- | Incremental Sync | No | |
5
+ ## Prerequisites
9
6
10
- This source syncs data from an ElasticSearch domain.
7
+ ### Requirements
11
8
12
- ## Supported Tables
9
+ - Elasticsearch endpoint URL
10
+ - Elasticsearch credentials (optional)
13
11
14
- This source automatically discovers all indices in the domain and can sync any of them.
12
+ ## Supported sync modes
15
13
16
- ## Getting Started \( Airbyte Open-Source\)
14
+ | Feature | Supported?\( Yes/No\) | Notes |
15
+ | :---------------- | :------------------- | :---- |
16
+ | Full Refresh Sync | Yes | |
17
+ | Incremental Sync | No | |
17
18
18
- #### Requirements
19
+ This source syncs data from an ElasticSearch domain.
19
20
20
- * Elasticsearch endpoint URL
21
- * Elasticsearch credentials (optional)
21
+ ## Supported Streams
22
+
23
+ This source automatically discovers all indices in the domain and can sync any of them.
22
24
23
- ### Performance Considerations
25
+ ## Performance Considerations
24
26
25
27
ElasticSearch calls may be rate limited by the underlying service.
26
28
This is specific to each deployment.
27
29
28
- #### Data type mapping
30
+ ## Data type map
29
31
30
32
Elasticsearch data types: https://www.elastic.co/guide/en/elasticsearch/reference/current/mapping-types.html
31
33
@@ -36,52 +38,50 @@ Any field can contain zero or more values by default, however,
36
38
all values in the array must be of the same data type. Hence, every field can be an array as well.
37
39
38
40
| Integration Type | Airbyte Type | Notes |
39
- | :--------------------------| :-------------------------------------------| :-----|
40
- | ` binary ` | ` ["string", "array"] ` | |
41
- | ` boolean ` | ` ["boolean", "array"] ` | |
42
- | ` keyword ` | ` ["string", "array", "number", "integer"] ` | |
43
- | ` constant_keyword ` | ` ["string", "array", "number", "integer"] ` | |
44
- | ` wildcard ` | ` ["string", "array", "number", "integer"] ` | |
45
- | ` long ` | ` ["integer", "array"] ` | |
46
- | ` unsigned_long ` | ` ["integer", "array"] ` | |
47
- | ` integer ` | ` ["integer", "array"] ` | |
48
- | ` short ` | ` ["integer", "array"] ` | |
49
- | ` byte ` | ` ["integer", "array"] ` | |
50
- | ` double ` | ` ["number", "array"] ` | |
51
- | ` float ` | ` ["number", "array"] ` | |
52
- | ` half_float ` | ` ["number", "array"] ` | |
53
- | ` scaled_float ` | ` ["number", "array"] ` | |
54
- | ` date ` | ` ["string", "array"] ` | |
55
- | ` date_nanos ` | ` ["number", "array"] ` | |
56
- | ` object ` | ` ["object", "array"] ` | |
57
- | ` flattened ` | ` ["object", "array"] ` | |
58
- | ` nested ` | ` ["object", "string"] ` | |
59
- | ` join ` | ` ["object", "string"] ` | |
60
- | ` integer_range ` | ` ["object", "array"] ` | |
61
- | ` float_range ` | ` ["object", "array"] ` | |
62
- | ` long_range ` | ` ["object", "array"] ` | |
63
- | ` double_range ` | ` ["object", "array"] ` | |
64
- | ` date_range ` | ` ["object", "array"] ` | |
65
- | ` ip_range ` | ` ["object", "array"] ` | |
66
- | ` ip ` | ` ["string", "array"] ` | |
67
- | ` version ` | ` ["string", "array"] ` | |
68
- | ` murmur3 ` | ` ["string", "array", "number", "integer"] ` | |
69
- | ` aggregate_metric_double ` | ` ["string", "array", "number", "integer"] ` | |
70
- | ` histogram ` | ` ["string", "array", "number", "integer"] ` | |
71
- | ` text ` | ` ["string", "array", "number", "integer"] ` | |
72
- | ` alias ` | ` ["string", "array", "number", "integer"] ` | |
73
- | ` search_as_you_type ` | ` ["string", "array", "number", "integer"] ` | |
74
- | ` token_count ` | ` ["string", "array", "number", "integer"] ` | |
75
- | ` dense_vector ` | ` ["string", "array", "number", "integer"] ` | |
76
- | ` geo_point ` | ` ["string", "array", "number", "integer"] ` | |
77
- | ` geo_shape ` | ` ["string", "array", "number", "integer"] ` | |
78
- | ` shape ` | ` ["string", "array", "number", "integer"] ` | |
79
- | ` point ` | ` ["string", "array", "number", "integer"] ` | |
80
-
81
-
82
-
41
+ | :------------------------ | :----------------------------------------- | :---- |
42
+ | ` binary ` | ` ["string", "array"] ` | |
43
+ | ` boolean ` | ` ["boolean", "array"] ` | |
44
+ | ` keyword ` | ` ["string", "array", "number", "integer"] ` | |
45
+ | ` constant_keyword ` | ` ["string", "array", "number", "integer"] ` | |
46
+ | ` wildcard ` | ` ["string", "array", "number", "integer"] ` | |
47
+ | ` long ` | ` ["integer", "array"] ` | |
48
+ | ` unsigned_long ` | ` ["integer", "array"] ` | |
49
+ | ` integer ` | ` ["integer", "array"] ` | |
50
+ | ` short ` | ` ["integer", "array"] ` | |
51
+ | ` byte ` | ` ["integer", "array"] ` | |
52
+ | ` double ` | ` ["number", "array"] ` | |
53
+ | ` float ` | ` ["number", "array"] ` | |
54
+ | ` half_float ` | ` ["number", "array"] ` | |
55
+ | ` scaled_float ` | ` ["number", "array"] ` | |
56
+ | ` date ` | ` ["string", "array"] ` | |
57
+ | ` date_nanos ` | ` ["number", "array"] ` | |
58
+ | ` object ` | ` ["object", "array"] ` | |
59
+ | ` flattened ` | ` ["object", "array"] ` | |
60
+ | ` nested ` | ` ["object", "string"] ` | |
61
+ | ` join ` | ` ["object", "string"] ` | |
62
+ | ` integer_range ` | ` ["object", "array"] ` | |
63
+ | ` float_range ` | ` ["object", "array"] ` | |
64
+ | ` long_range ` | ` ["object", "array"] ` | |
65
+ | ` double_range ` | ` ["object", "array"] ` | |
66
+ | ` date_range ` | ` ["object", "array"] ` | |
67
+ | ` ip_range ` | ` ["object", "array"] ` | |
68
+ | ` ip ` | ` ["string", "array"] ` | |
69
+ | ` version ` | ` ["string", "array"] ` | |
70
+ | ` murmur3 ` | ` ["string", "array", "number", "integer"] ` | |
71
+ | ` aggregate_metric_double ` | ` ["string", "array", "number", "integer"] ` | |
72
+ | ` histogram ` | ` ["string", "array", "number", "integer"] ` | |
73
+ | ` text ` | ` ["string", "array", "number", "integer"] ` | |
74
+ | ` alias ` | ` ["string", "array", "number", "integer"] ` | |
75
+ | ` search_as_you_type ` | ` ["string", "array", "number", "integer"] ` | |
76
+ | ` token_count ` | ` ["string", "array", "number", "integer"] ` | |
77
+ | ` dense_vector ` | ` ["string", "array", "number", "integer"] ` | |
78
+ | ` geo_point ` | ` ["string", "array", "number", "integer"] ` | |
79
+ | ` geo_shape ` | ` ["string", "array", "number", "integer"] ` | |
80
+ | ` shape ` | ` ["string", "array", "number", "integer"] ` | |
81
+ | ` point ` | ` ["string", "array", "number", "integer"] ` | |
83
82
84
83
## Changelog
85
- | Version | Date | Pull Request | Subject |
86
- | :--------| :--- | :--- | :--- |
84
+
85
+ | Version | Date | Pull Request | Subject |
86
+ | :------ | :--------- | :------------------------------------------------------- | :-------------- |
87
87
| ` 0.1.0 ` | 2022-07-12 | [ 14118] ( https://github.com/airbytehq/airbyte/pull/14118 ) | Initial Release |
0 commit comments