Skip to content

Support a Custom Deserialiser on JSON Kafka Load Routine #57696

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
rlapao opened this issue Apr 7, 2025 · 1 comment
Open

Support a Custom Deserialiser on JSON Kafka Load Routine #57696

rlapao opened this issue Apr 7, 2025 · 1 comment

Comments

@rlapao
Copy link

rlapao commented Apr 7, 2025

Feature request

Is your feature request related to a problem? Please describe.
Yes. I was trying to consume a JSON Kafka topic that uses Confluent Schema Registry (JSON Schema) getting the following error: previous task aborted because of illegal json started with . This happens due to the format of Confluent JSON Schema Registry messages is schema_id { ... valid json message ... } which makes this message an invalida JSON message.

Describe the solution you'd like
Support a Custom Deserialiser on JSON Kafka Load Routine.

Describe alternatives you've considered
Support Confluent Schema Registry format in JSON Kafka Load Routines.

@rlapao rlapao changed the title Support a Custom Deserialiser on Kafka Load Routine Support a Custom Deserialiser on JSON Kafka Load Routine Apr 7, 2025
@jaogoy
Copy link
Contributor

jaogoy commented Apr 7, 2025

Routine Load supports loading avro formt data + schema registry.
I wonder that are your schema registry messages in the data flow the same as normal data messages?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants