Skip to content

Persist normalization job failure reasons #14310

Closed
@sherifnada

Description

@sherifnada

Tell us about the problem you're trying to solve

If normalization fails, we currently only store the higher-level Temporal scheduling error in the Airbyte db, not the actual failure coming from Normalization (python error from the normalization code or DBT error coming from running normalization on the destination)

Describe the solution you’d like

We should use TRACE messaging to signal errors with attached failure reasons and use this to persists Normalization failure reasons correctly.

This then enables #14926 so we can track Normalization issues in Sentry

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions