Skip to content

Data is missing from the destination for columns that contain a $ in their name. #42480

Closed
@fauxpasonics

Description

@fauxpasonics

Platform Version

63.5+

What step the error happened?

Sync

Relevant information

A single stream (table) connection that is working fine in v63.4 and lower suddenly stops pulling data in the columns that have a $ in their name upon upgrading to v63.5 or higher (have tested with 63.6,63.7,63.8 and 63.9).

Source: source-oracle:0.5.2 but it does not seem to be connector version related - I have manually run the docker container and can see that the RECORD output does contain all the data.
Destination: Snowflake: 3.10.1+ (have tried with 3.11.4 and 3.10.1) but it does not seem to be connector version related.

Example Column Names that lose data: CF$_CONFIGURATOR_PRICE,
CF$_MARKET, CF$_ORDER_NO

This appears to be a platform issue as reverting to versions <=63.4 fixes it, but I have been unable to find the PR in the 63.5 release that would be causing it. - perhaps #39473 and all the changes to staging could have caused it somehow?

Relevant log output

No response

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions