-
Notifications
You must be signed in to change notification settings - Fork 970
feat: use different internal link than the table details page on lineage #2006
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
allisonsuarez
commented
Oct 11, 2022
- use a link received from metadata that is different than the one that directs you to a new table details page for the table items list
Signed-off-by: Allison Suarez Miranda <[email protected]>
Signed-off-by: Allison Suarez Miranda <[email protected]>
Signed-off-by: Allison Suarez Miranda <[email protected]>
Signed-off-by: Allison Suarez Miranda <[email protected]>
@@ -17,6 +17,7 @@ class LineageItem: | |||
badges: Optional[List[Badge]] = None | |||
usage: Optional[int] = None # statistic to sort lineage items by | |||
parent: Optional[str] = None # key of the parent entity, used to create the relationships in graph | |||
link: Optional[str] = None # internal link to redirect to different than the resource details page |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@allisonsuarez do you compute lineage internally now at Lyft? or still rely on 3rd party tool like complierworks?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We are doing it in house now
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
For spark we are using open lineage to collect the lineage but other query engines have their own support for getting lineage data
Signed-off-by: Allison Suarez Miranda <[email protected]>