Skip to content

source-file: NaN is not a valid JSON value #1246

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
ChristopheDuong opened this issue Dec 8, 2020 · 0 comments
Closed

source-file: NaN is not a valid JSON value #1246

ChristopheDuong opened this issue Dec 8, 2020 · 0 comments
Assignees
Labels
type/bug Something isn't working

Comments

@ChristopheDuong
Copy link
Contributor

Expected Behavior

If the file that is being replicated contains float/double columns with NaN values, source-file should transmit valid RECORD Airbyte Messages.

Current Behavior

Tell us what happens instead of the expected behavior.
The source-file python code is reading/parsing the file fine but when emitting the values into the JSON stream for transit via airbyte protocol, it is not well recognized/parsed and output 'ERROR' messages in the integrationRunner class (line 133) as it wasn't able to properly read the JSON stream. (NaN is not a valid value for numbers in JSON)

Steps to Reproduce

  1. For example you can setup the source-file to replicate the following csv file:
    https://raw.githubusercontent.com/opencovid19-fr/data/master/dist/chiffres-cles.csv
  2. No data rows is being replicated as all the rows contains NaN values...

Severity of the bug for you

Medium

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type/bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant