Airbyte API doesn't support the "Full Refresh - Overwrite + Deduped" sync mode when creating connections

[alexambarch]

Topic

API Issues

Relevant information

It doesn't appear that the Airbyte API is capable of creating a stream with a sync mode of Full Refresh - Overwrite + Deduped. I'm unable to find references to it in the API documentation. This issue trickles down to the Terraform provider, which can't create these streams either.

We'd like to be able to use Terraform to completely control our Airbyte configuration, but this is preventing us from doing so.

[tomdarmon-appstack]

Hello, I'm trying to create streams with the Full Refresh - Overwrite + Deduped using the API and there is no documentation provided for this. I'm not sure if this is achievable or not.

[lucjankonopka]

Same here.

I'm trying to create a connection using the Terraform Airbyte provider and set destination_sync_mode to full_refresh_overwrite_deduped

According to the Terraform Documentation, this appears to be a valid combination.

However, when I try to apply this config, I get an error that "+deduped" mode is not supported.

Error Message:

Cannot deserialize value of type ConnectionSyncModeEnum from String "full_refresh_overwrite_deduped": not one of the values accepted for Enum class:
[incremental_deduped_history, full_refresh_append, incremental_append, full_refresh_overwrite]

[alexambarch]

@lucjankonopka What version of the Terraform provider are you using? There was an update recently that has allowed me to use full_refresh_overwrite_deduped on a connection, but I needed to upgrade the provider.

[lucjankonopka]

Hey @alexambarch!
I'm using version = "= 0.10.0" which should has this option, according to the latest provider documentation.
I've also tried 0.11.0 and 0.12.0, but with no results...

What provider did you use?