[FEATURE]: LLM-Assisted Data Quality Rules Converter

[mwojtyczka]

Is there an existing issue for this?

• I have searched the existing issues

Problem statement

Migrating from existing quality solution to DQX may pose some challenges since each tool has it's own syntax and way of doing things.

Proposed Solution

Provide ability to read existing Data Quality rules in pre-defined formats (generally SQL queries, Config JSONs /YAMLs, Spark embedded SQL rules) and generate DQ checks compatible with DQX (config.yaml) for ease of movement to DQX. This reduces the friction of moving from an existing Data Quality Solution to DQX.

Additional Context

This will depend on the actual quality system currently used, we can support the most popular.