Skip to content

Implement v0 of no-code CDK #11898

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
9 of 11 tasks
Tracked by #11582
girarda opened this issue Apr 11, 2022 · 0 comments
Closed
9 of 11 tasks
Tracked by #11582

Implement v0 of no-code CDK #11898

girarda opened this issue Apr 11, 2022 · 0 comments
Assignees
Labels

Comments

@girarda
Copy link
Contributor

girarda commented Apr 11, 2022

Tell us about the problem you're trying to solve

Following up on #11897
MVP the features we want to implement.

Describe the solution you’d like

Implement the thinest vertical allowing us to field test the new CDK.

WIP design doc: https://docs.google.com/document/d/1fNmhMKujHqccsrXF-ZIP3pP_7ZdjFNft4c7a9FMZZJY/edit#

A good target is to implement the persistiq connector as no code as this connector is using a very straightforward connector that only uses high-leverage features.

Once the core of the CDK is implemented, we can build more complex features to support Stripe (for substreams), Tiktok-marketing (for semi-increntals), and Strava (for OAuth)

Implementation steps:

  1. Implement Source + Stream that can read a yaml config as described in the design doc
  • Implement Source
  • Implement DefaultExtractor
  • Implement HttpRequester
  • Implement JsonDecoder
  • Implement Datetime iterator
  • Implement extrapolator using Jinja
  • Implement sendgrid as no-code
  1. Implement parsing layer to go from DSL -> canonical connector configuration (yaml form)
  1. Streamline packaging for low-code connectors

Out of scope:

  • support for substreams
  • further improvements to the DSL such as implementing an intellij plugin or adding sugar coating to simplify the DSL
@girarda girarda added type/enhancement New feature or request needs-triage labels Apr 11, 2022
@girarda girarda moved this to Non-groomed backlog in API Sources DX Roadmap Apr 11, 2022
@girarda girarda changed the title Implement a connector as config Implement v0 of no-code CDK Apr 12, 2022
@girarda girarda moved this from Non-groomed backlog to Ready for implementation (current sprint) in API Sources DX Roadmap May 5, 2022
@girarda girarda closed this as completed Jun 2, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Status: Done
Development

No branches or pull requests

3 participants