-
Notifications
You must be signed in to change notification settings - Fork 4.5k
MySQL Source : support different table structure during "DESCRIBE" query #24147
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
MySQL Source : support different table structure during "DESCRIBE" query #24147
Conversation
/test connector=connectors/source-mysql
Build PassedTest summary info:
|
Affected Connector ReportNOTE
|
Connector | Version | Changelog | Publish |
---|---|---|---|
source-mysql |
2.0.4 |
✅ | ✅ |
source-mysql-strict-encrypt |
2.0.4 |
🔵 (ignored) |
🔵 (ignored) |
- See "Actionable Items" below for how to resolve warnings and errors.
✅ Destinations (0)
Connector | Version | Changelog | Publish |
---|
- See "Actionable Items" below for how to resolve warnings and errors.
✅ Other Modules (0)
Actionable Items
(click to expand)
Category | Status | Actionable Item |
---|---|---|
Version | ❌ mismatch |
The version of the connector is different from its normal variant. Please bump the version of the connector. |
⚠ doc not found |
The connector does not seem to have a documentation file. This can be normal (e.g. basic connector like source-jdbc is not published or documented). Please double-check to make sure that it is not a bug. |
|
Changelog | ⚠ doc not found |
The connector does not seem to have a documentation file. This can be normal (e.g. basic connector like source-jdbc is not published or documented). Please double-check to make sure that it is not a bug. |
❌ changelog missing |
There is no chnagelog for the current version of the connector. If you are the author of the current version, please add a changelog. | |
Publish | ⚠ not in seed |
The connector is not in the seed file (e.g. source_definitions.yaml ), so its publication status cannot be checked. This can be normal (e.g. some connectors are cloud-specific, and only listed in the cloud seed file). Please double-check to make sure that it is not a bug. |
❌ diff seed version |
The connector exists in the seed file, but the latest version is not listed there. This usually means that the latest version is not published. Please use the /publish command to publish the latest version. |
…rsions' into mysql-describe-table-for-diff-versions
/publish connector=connectors/source-mysql
if you have connectors that successfully published but failed definition generation, follow step 4 here |
/publish connector=connectors/source-mysql-strict-encrypt
if you have connectors that successfully published but failed definition generation, follow step 4 here |
Looks good in general. Can you quickly mention which versions of MySQL correspond to which versions of the |
…ery (#24147) * MySQL Source : support different table structure during "DESCRIBE" query * bump version * auto-bump connector version --------- Co-authored-by: Octavia Squidington III <[email protected]>
…ery (#24147) * MySQL Source : support different table structure during "DESCRIBE" query * bump version * auto-bump connector version --------- Co-authored-by: Octavia Squidington III <[email protected]>
What
DESCRIBE <table_name> query in MySQL can return a different table structure depending on the version of the database
In one case, this structure has the form
{"Field":"<column_name>","Type":"<datatype_in_db>","Null":"<nullability(YES, NO)>","Key":"","Extra":"<extra_params>"}
in other cases
{"COLUMN_NAME":"<column_name>","COLUMN_TYPE":"<datatype_in_db>","IS_NULLABLE":"<nullability(YES, NO)>","COLUMN_KEY":"","EXTRA":"<extra_params>"}
How
Support both of these query results
Monitor these logs for whether the sync was successful or not : https://github.com/airbytehq/oncall/issues/1654