-
Notifications
You must be signed in to change notification settings - Fork 4.5k
Destination BigQuery: timestamps without timezone should be mapped to DATETIME #12660
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Comments
As datatype mapping for destiantion-bigquery should be done on the normalization side, I'm moving this ticket to the board of Phyton team |
@edgao does this issue depend (should it depend) on us implementing changes for handling data types using the new protocol version? |
Seems to be already implemented as part of this PR |
@etsybaev could you please run a test (manual test is fine in this case) to confirm that this is working as expected? |
Due to new updates in the building of JSON schema, a new property
"airbyte_type"
was added to the field description.One of the possible values for
"airbyte_type"
is"timestamp_without_timezone"
. Now"airbyte_type"
is ignored and all"timestamp_without_timezone"
fields with"format":"date-time"
are mapped asTIMESTAMP
in destination BigQuery.According to #11090 and this comment all fields with
"airbyte_type": "timestamp_without_timezone"
should be mapped asDATETIME
in destination BigQuery.Input JSON schema example:
Input data example:
The text was updated successfully, but these errors were encountered: