Skip to content

Change the settings page in the UI to display the union of the schema and the configured schema #9902

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
Tracked by #9895
cgardens opened this issue Jan 31, 2022 · 1 comment · Fixed by #11611
Closed
Tracked by #9895
Assignees
Labels

Comments

@cgardens
Copy link
Contributor

Epic: #9895

Tell us about the problem you're trying to solve

Currently the UI gets the catalog for a source from sources/discover_schema. It is then used to create a connection connections/create.

The configured catalog can be lossy. For example, if the catalog from discover_schema has stream1 and stream2, but then the connection only configures stream1, then the user will never be able to see that stream again in the UI (unless they click force refresh schema). This is very confusing. Our goal is not forget this information. Thus, when loading the settings page, we should use the information page and call sources/discover_schema. With the new caching behavior in this endpoint (#9901), this will be cheap. We can then use that catalog in the settings page and then mask the actual configuration on top of it. If needed, we can do this on the backend first. We should discuss the right interface here.

@cgardens cgardens added type/enhancement New feature or request area/frontend area/platform issues related to the platform labels Jan 31, 2022
@jrhizor
Copy link
Contributor

jrhizor commented Jan 31, 2022

related: #9738

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants