Open
Description
Connector Name
source-file
Connector Version
0.5.28
What step the error happened?
Other
Relevant information
I am importing a CSV file that has two columns that are date fields (datepublished, datepublic) in ISO 8601 date format (2020-01-10T13:20:12). I have the following option set in Reader Options:
{"parse_dates": ["datepublished", "datepublic"]}
However those fields are not being parsed as date values. They are falling back to string values in the Airbyte schema and are being imported into Postgres as varchar dtype. I have also tried forcing data type for those fields in reader options using dtype: ["field": "datetime64"] however I get an error message saying that setting datetime64 using dtype is not supported and to use the parse_date option instead.
Relevant log output
Contribute
- Yes, I want to contribute